[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:29 dist-test-slave-2w3w krb5kdc[15046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:29 dist-test-slave-2w3w krb5kdc[15046](info): set up 2 sockets
Aug 09 01:57:29 dist-test-slave-2w3w krb5kdc[15046](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 01:57:30.610651 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.007s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:30 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:30.739316 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:46033
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:46033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:30.902770 15059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:30.903074 15059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:30.903160 15059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:30.907119 15059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:30.907243 15059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:30.907306 15059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:30.907366 15059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:30.907405 15059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:30.912650 15059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:46033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:46033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:30.914088 15059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:30.915416 15059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:30.928758 15066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:30.928792 15069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:30.928979 15064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:30.928891 15059 server_base.cc:1034] running on GCE node
I20260809 01:57:30.929769 15059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:30.931555 15059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:30.932735 15059 hybrid_clock.cc:648] HybridClock initialized: now 1786240650932724 us; error 51 us; skew 500 ppm
Aug 09 01:57:30 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240650, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:30.935904 15059 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:30.937034 15059 webserver.cc:460] Webserver started at http://127.14.175.254:43925/ using document root <none> and password file <none>
I20260809 01:57:30.937875 15059 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:30.937944 15059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:30.938268 15059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:30.941254 15059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "40f4e8e409bd4bfea66c2f7285c054b2"
format_stamp: "Formatted at 2026-08-09 01:57:30 on dist-test-slave-2w3w"
server_key: "076541211bd1a7ce0d8462c96b65395b"
server_key_iv: "d5029b35d2b2ee83c915a4a6eb71e116"
server_key_version: "encryptionkey@0"
I20260809 01:57:30.941792 15059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "40f4e8e409bd4bfea66c2f7285c054b2"
format_stamp: "Formatted at 2026-08-09 01:57:30 on dist-test-slave-2w3w"
server_key: "076541211bd1a7ce0d8462c96b65395b"
server_key_iv: "d5029b35d2b2ee83c915a4a6eb71e116"
server_key_version: "encryptionkey@0"
I20260809 01:57:30.946647 15059 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 01:57:30.949951 15077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:30.951553 15059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:30.951750 15059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "40f4e8e409bd4bfea66c2f7285c054b2"
format_stamp: "Formatted at 2026-08-09 01:57:30 on dist-test-slave-2w3w"
server_key: "076541211bd1a7ce0d8462c96b65395b"
server_key_iv: "d5029b35d2b2ee83c915a4a6eb71e116"
server_key_version: "encryptionkey@0"
I20260809 01:57:30.951867 15059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:30.964193 15059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:30.967779 15059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:30.968030 15059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:30.976655 15059 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:46033
I20260809 01:57:30.976774 15131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:46033 every 8 connection(s)
I20260809 01:57:30.977922 15059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:30.982245 15132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:30.986990 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15059
I20260809 01:57:30.987193 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:30.989101 15039 external_mini_cluster.cc:1428] Setting key 2d4f6b0b31fb8de427ae48e3414f1371
I20260809 01:57:30.991384 15132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: Bootstrap starting.
I20260809 01:57:30.995899 15132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:30.997381 15132 log.cc:824] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:31.000523 15132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: No bootstrap required, opened a new log
I20260809 01:57:31.006443 15132 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } }
I20260809 01:57:31.006702 15132 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:31.006815 15132 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f4e8e409bd4bfea66c2f7285c054b2, State: Initialized, Role: FOLLOWER
I20260809 01:57:31.007558 15132 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } }
I20260809 01:57:31.007771 15132 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:31.007906 15132 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:31.008059 15132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:31.009012 15132 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } }
I20260809 01:57:31.009624 15132 leader_election.cc:302] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40f4e8e409bd4bfea66c2f7285c054b2; no voters:
I20260809 01:57:31.010051 15132 leader_election.cc:288] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:31.010187 15138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:31.010401 15138 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [term 1 LEADER]: Becoming Leader. State: Replica: 40f4e8e409bd4bfea66c2f7285c054b2, State: Running, Role: LEADER
I20260809 01:57:31.010879 15138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } }
I20260809 01:57:31.011907 15132 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:31.013803 15139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } } }
I20260809 01:57:31.013829 15141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40f4e8e409bd4bfea66c2f7285c054b2. Latest consensus state: current_term: 1 leader_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f4e8e409bd4bfea66c2f7285c054b2" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 46033 } } }
I20260809 01:57:31.013927 15139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:31.013927 15141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2 [sys.catalog]: This master's current role is: LEADER
W20260809 01:57:31.019716 15156 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:31.019876 15156 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:31.019975 15148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:31.021132 15148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:31.022102 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:30.996635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.14.175.254:46033)
0809 01:57:30.997071 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:30.997087 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:30.997154 (+ 67us) server_negotiation.cc:407] Connection header received
0809 01:57:31.001345 (+ 4191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.001360 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.001763 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.002031 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.005723 (+ 3692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.006826 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.008310 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.008773 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.008952 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.013907 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.013941 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.013956 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.013988 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.016759 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.017523 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.017529 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.017534 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.017753 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.018283 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.018286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.018296 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.019119 (+ 823us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.019387 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.020288 (+ 901us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.020737 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":136,"threads_started":1}
I20260809 01:57:31.028905 15148 catalog_manager.cc:1347] Generated new cluster ID: 70e15cb7f98b4083979aa25076576ecf
I20260809 01:57:31.028985 15148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:31.043366 15148 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:31.044291 15148 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:31.054339 15148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40f4e8e409bd4bfea66c2f7285c054b2: Generated new TSK 0
I20260809 01:57:31.055299 15148 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:31.093955 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:31.238294 15161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:31.238574 15161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:31.238647 15161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:31.242689 15161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:31.242769 15161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:31.242861 15161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:31.248098 15161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:31.249085 15161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:31.250029 15161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:31.259824 15169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:31.259872 15168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:31.259896 15171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:31.260022 15161 server_base.cc:1034] running on GCE node
I20260809 01:57:31.260438 15161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:31.261159 15161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:31.262351 15161 hybrid_clock.cc:648] HybridClock initialized: now 1786240651262337 us; error 27 us; skew 500 ppm
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:31.265058 15161 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:31.265846 15161 webserver.cc:460] Webserver started at http://127.14.175.193:36973/ using document root <none> and password file <none>
I20260809 01:57:31.266379 15161 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:31.266465 15161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:31.266685 15161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:31.268941 15161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "3566d6540b2e458c91145eb4d5381332"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "b5c2c08f2d09c119ce4ce1f7c5b76db2"
server_key_iv: "9e1e792e4af9cd041a0c55f5b91acc8f"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.269593 15161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "3566d6540b2e458c91145eb4d5381332"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "b5c2c08f2d09c119ce4ce1f7c5b76db2"
server_key_iv: "9e1e792e4af9cd041a0c55f5b91acc8f"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.273221 15161 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:31.275506 15179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.276613 15161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:31.276738 15161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "3566d6540b2e458c91145eb4d5381332"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "b5c2c08f2d09c119ce4ce1f7c5b76db2"
server_key_iv: "9e1e792e4af9cd041a0c55f5b91acc8f"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.276859 15161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:31.304442 15161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:31.307206 15161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:31.307418 15161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:31.308193 15161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:31.309283 15161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:31.309357 15161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.309428 15161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:31.309471 15161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.319501 15161 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:41573
I20260809 01:57:31.319554 15296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:41573 every 8 connection(s)
I20260809 01:57:31.320392 15161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:31.321592 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15161
I20260809 01:57:31.321679 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:31.321946 15039 external_mini_cluster.cc:1428] Setting key 9fe8eaa50723eb33e466cbddef9d4798
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:57:31.335603 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.322626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:43967 (local address 127.14.175.254:46033)
0809 01:57:31.322784 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:31.322788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:31.323876 (+ 1088us) server_negotiation.cc:407] Connection header received
0809 01:57:31.325452 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.325456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.325507 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.325558 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.326869 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.327748 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.329007 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.329445 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.329598 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.331973 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.331978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.331982 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.332013 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.333475 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.334128 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.334130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.334132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.334211 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.334530 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.334532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.334533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.334695 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.334783 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.335343 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.335442 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:57:31.336635 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.323053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:46033 (local address 127.14.175.193:43967)
0809 01:57:31.323520 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:31.323572 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:31.325214 (+ 1642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:31.325915 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:31.325921 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:31.326271 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:31.326717 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.326729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.327886 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.327890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.328855 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.328865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.329607 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.329610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.329747 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.330342 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:31.330357 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:31.331801 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:31.333611 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.333616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.333625 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.334023 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.334295 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.334297 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.334299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.334440 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.334793 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:31.334798 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:31.335143 (+ 345us) client_negotiation.cc:769] Sending connection context
0809 01:57:31.335294 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 01:57:31.335632 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":143,"threads_started":1}
I20260809 01:57:31.337944 15297 heartbeater.cc:347] Connected to a master server at 127.14.175.254:46033
I20260809 01:57:31.338187 15297 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:31.338639 15297 heartbeater.cc:511] Master 127.14.175.254:46033 requested a full tablet report, sending...
I20260809 01:57:31.340651 15096 ts_manager.cc:194] Registered new tserver with Master: 3566d6540b2e458c91145eb4d5381332 (127.14.175.193:41573)
I20260809 01:57:31.342801 15096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:43967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:31.353909 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:31.485345 15302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:31.485600 15302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:31.485646 15302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:31.489810 15302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:31.489868 15302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:31.489965 15302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:31.495383 15302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:31.496415 15302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:31.497431 15302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:31.508312 15309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:31.508427 15311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:31.508462 15302 server_base.cc:1034] running on GCE node
W20260809 01:57:31.508483 15308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:31.508955 15302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:31.509579 15302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:31.510738 15302 hybrid_clock.cc:648] HybridClock initialized: now 1786240651510719 us; error 37 us; skew 500 ppm
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:31.514202 15302 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:31.515192 15302 webserver.cc:460] Webserver started at http://127.14.175.194:39491/ using document root <none> and password file <none>
I20260809 01:57:31.515810 15302 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:31.515906 15302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:31.516121 15302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:31.518229 15302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "a1598d8c37894bcbbc691cd83f3b4742"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "e8e2a5a87af44168e494040c3ec87692"
server_key_iv: "86061ed956e63adfc100f0d9bec275e5"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.518843 15302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "a1598d8c37894bcbbc691cd83f3b4742"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "e8e2a5a87af44168e494040c3ec87692"
server_key_iv: "86061ed956e63adfc100f0d9bec275e5"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.522792 15302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 01:57:31.525269 15319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.526436 15302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:31.526578 15302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "a1598d8c37894bcbbc691cd83f3b4742"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "e8e2a5a87af44168e494040c3ec87692"
server_key_iv: "86061ed956e63adfc100f0d9bec275e5"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.526687 15302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:31.552271 15302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:31.555895 15302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:31.556149 15302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:31.556934 15302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:31.557883 15302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:31.557956 15302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.558025 15302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:31.558080 15302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.576692 15302 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:45995
I20260809 01:57:31.576715 15439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:45995 every 8 connection(s)
I20260809 01:57:31.577625 15302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:31.580891 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15302
I20260809 01:57:31.581000 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:31.581331 15039 external_mini_cluster.cc:1428] Setting key c2c88f8250de6b42cebe2e2614e25cb8
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:31.594395 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.579645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:49659 (local address 127.14.175.254:46033)
0809 01:57:31.579784 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:31.579788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:31.580767 (+ 979us) server_negotiation.cc:407] Connection header received
0809 01:57:31.582764 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.582767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.582851 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.582946 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.584815 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.585366 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.586714 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.586952 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.587088 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.589937 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.589942 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.589947 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.589977 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.592085 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.592657 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.592662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.592663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.592757 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.593128 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.593133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.593136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.593488 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.593592 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.594159 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.594274 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 01:57:31.595402 15442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.580020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:46033 (local address 127.14.175.194:49659)
0809 01:57:31.580530 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:31.580573 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:31.582545 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:31.583183 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:31.583192 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:31.583791 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:31.584642 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.584667 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.585500 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.585504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.586580 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.586589 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.587126 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.587130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.587364 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.588112 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:31.588128 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:31.589759 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:31.592229 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.592234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.592246 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.592527 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.592867 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.592870 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.592871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.593019 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.593606 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:31.593611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:31.593905 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 01:57:31.594073 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 01:57:31.594340 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:57:31.596782 15440 heartbeater.cc:347] Connected to a master server at 127.14.175.254:46033
I20260809 01:57:31.597036 15440 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:31.597630 15440 heartbeater.cc:511] Master 127.14.175.254:46033 requested a full tablet report, sending...
I20260809 01:57:31.599086 15096 ts_manager.cc:194] Registered new tserver with Master: a1598d8c37894bcbbc691cd83f3b4742 (127.14.175.194:45995)
I20260809 01:57:31.599982 15096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:49659
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:31.614207 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:31.739557 15445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:31.739778 15445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:31.739845 15445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:31.743959 15445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:31.744015 15445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:31.744122 15445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:31.749507 15445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:46033
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:31.750396 15445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:31.751327 15445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:31.760442 15456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:31.760531 15445 server_base.cc:1034] running on GCE node
W20260809 01:57:31.760490 15453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:31.760674 15454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:31.761166 15445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:31.761729 15445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:31.762912 15445 hybrid_clock.cc:648] HybridClock initialized: now 1786240651762883 us; error 40 us; skew 500 ppm
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:31.765627 15445 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:31.766448 15445 webserver.cc:460] Webserver started at http://127.14.175.195:36263/ using document root <none> and password file <none>
I20260809 01:57:31.767031 15445 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:31.767119 15445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:31.767351 15445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:31.769284 15445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "60e0bb7a0e0c40f8b75f19d81a257a1d"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "77b1715ecb368f8c7a0d57be71012aa0"
server_key_iv: "655bac9a0baef6aa650bdf3480c787eb"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.769834 15445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "60e0bb7a0e0c40f8b75f19d81a257a1d"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "77b1715ecb368f8c7a0d57be71012aa0"
server_key_iv: "655bac9a0baef6aa650bdf3480c787eb"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.773667 15445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 01:57:31.775939 15463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.777064 15445 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:31.777204 15445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "60e0bb7a0e0c40f8b75f19d81a257a1d"
format_stamp: "Formatted at 2026-08-09 01:57:31 on dist-test-slave-2w3w"
server_key: "77b1715ecb368f8c7a0d57be71012aa0"
server_key_iv: "655bac9a0baef6aa650bdf3480c787eb"
server_key_version: "encryptionkey@0"
I20260809 01:57:31.777344 15445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:31.795572 15445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:31.798173 15445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:31.798377 15445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:31.798933 15445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:31.799751 15445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:31.799816 15445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.799885 15445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:31.799944 15445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:31.809780 15445 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:40029
I20260809 01:57:31.809863 15581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:40029 every 8 connection(s)
I20260809 01:57:31.810683 15445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:31.811245 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15445
I20260809 01:57:31.811388 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:31.811692 15039 external_mini_cluster.cc:1428] Setting key 5d9b5b74e11ca5a650277d945b2b008a
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:31.824124 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.812649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:39181 (local address 127.14.175.254:46033)
0809 01:57:31.812771 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:31.812775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:31.814520 (+ 1745us) server_negotiation.cc:407] Connection header received
0809 01:57:31.815529 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.815531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.815578 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.815653 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.816732 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.817269 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.818339 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.818547 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.818624 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.820954 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.820957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.820959 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.820981 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.822377 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.822821 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.822824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.822825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.822896 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.823244 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.823247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.823248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.823412 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.823490 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.823905 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.823998 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 01:57:31.824870 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.813164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:46033 (local address 127.14.175.195:39181)
0809 01:57:31.814383 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:31.814424 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:31.815346 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:31.815804 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:31.815810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:31.816174 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:31.816616 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.816627 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.817375 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.817377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.818237 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:31.818246 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.818669 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.818671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:31.818805 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.819373 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:31.819389 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:31.820805 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:31.822482 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.822486 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.822496 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.822733 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.823031 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:31.823034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:31.823036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:31.823164 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:31.823499 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:31.823503 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:31.823705 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 01:57:31.823844 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 01:57:31.824072 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":844,"threads_started":1}
I20260809 01:57:31.826038 15582 heartbeater.cc:347] Connected to a master server at 127.14.175.254:46033
I20260809 01:57:31.826279 15582 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:31.826762 15582 heartbeater.cc:511] Master 127.14.175.254:46033 requested a full tablet report, sending...
I20260809 01:57:31.827790 15096 ts_manager.cc:194] Registered new tserver with Master: 60e0bb7a0e0c40f8b75f19d81a257a1d (127.14.175.195:40029)
I20260809 01:57:31.828352 15096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:39181
I20260809 01:57:31.838073 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:31.864418 15589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.855169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.14.175.193:41573)
0809 01:57:31.855544 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:31.855550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:31.855574 (+ 24us) server_negotiation.cc:407] Connection header received
0809 01:57:31.855620 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.855625 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.855793 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.855956 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.856653 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.857572 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.858374 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.858734 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.858816 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.861115 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.861124 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.861136 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.861158 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.862801 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.863232 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.863237 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.863238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.863320 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.863549 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.863551 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.863552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.863761 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.863917 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.864062 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.864227 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":139,"threads_started":1}
W20260809 01:57:31.865433 15207 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35262
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:31.891944 15589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:31.883772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35272 (local address 127.14.175.193:41573)
0809 01:57:31.883969 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:31.883973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:31.883988 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:31.884140 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:31.884143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:31.884193 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:31.884271 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:31.885003 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.885508 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.886284 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:31.886504 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:31.886585 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:31.888891 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:31.888894 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:31.888896 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:31.888919 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:31.890389 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.890739 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.890742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.890743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.890876 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:31.891154 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:31.891157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:31.891158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:31.891309 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:31.891410 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:31.891615 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 01:57:31.891705 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260809 01:57:31.893043 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15161
I20260809 01:57:31.900055 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15302
I20260809 01:57:31.907064 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15445
I20260809 01:57:31.913218 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15059
2026-08-09T01:57:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2399 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15598](info): set up 2 sockets
Aug 09 01:57:31 dist-test-slave-2w3w krb5kdc[15598](info): commencing operation
krb5kdc: starting...
W20260809 01:57:32.998809 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:33.133417 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40527
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40527
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:33.241004 15611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:33.241273 15611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:33.241346 15611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:33.245299 15611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:33.245386 15611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:33.245426 15611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:33.245483 15611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:33.245524 15611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:33.250545 15611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40527
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:33.251487 15611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:33.252421 15611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:33.260685 15619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.260699 15616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.260936 15611 server_base.cc:1034] running on GCE node
W20260809 01:57:33.260702 15617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.261631 15611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:33.262665 15611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:33.263863 15611 hybrid_clock.cc:648] HybridClock initialized: now 1786240653263825 us; error 48 us; skew 500 ppm
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:33.266508 15611 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:33.267351 15611 webserver.cc:460] Webserver started at http://127.14.175.254:38779/ using document root <none> and password file <none>
I20260809 01:57:33.267828 15611 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:33.267886 15611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:33.268049 15611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:33.270016 15611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "bb9435bc66514a4fa61588a5a8fcb082"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "5dedad8c00e9e214bb0f16ea5b49aa36"
server_key_iv: "c1f87da33415e2f32306b42e804abf3f"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.270519 15611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "bb9435bc66514a4fa61588a5a8fcb082"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "5dedad8c00e9e214bb0f16ea5b49aa36"
server_key_iv: "c1f87da33415e2f32306b42e804abf3f"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.273941 15611 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:57:33.276242 15626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.277381 15611 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:33.277505 15611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "bb9435bc66514a4fa61588a5a8fcb082"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "5dedad8c00e9e214bb0f16ea5b49aa36"
server_key_iv: "c1f87da33415e2f32306b42e804abf3f"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.277604 15611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:33.290328 15611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:33.293020 15611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:33.293226 15611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:33.300153 15611 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40527
I20260809 01:57:33.300225 15681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40527 every 8 connection(s)
I20260809 01:57:33.301084 15611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:33.303759 15682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:33.308933 15682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: Bootstrap starting.
I20260809 01:57:33.309322 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15611
I20260809 01:57:33.309417 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:33.309675 15039 external_mini_cluster.cc:1428] Setting key 77c787a62ac3c83e91253cc07163801c
I20260809 01:57:33.311443 15682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:33.312137 15682 log.cc:824] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:33.314201 15682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: No bootstrap required, opened a new log
I20260809 01:57:33.318109 15682 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } }
I20260809 01:57:33.318342 15682 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:33.318425 15682 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9435bc66514a4fa61588a5a8fcb082, State: Initialized, Role: FOLLOWER
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:33.318886 15682 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } }
I20260809 01:57:33.319070 15682 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:33.319169 15682 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:33.319295 15682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:33.320148 15682 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } }
I20260809 01:57:33.320502 15682 leader_election.cc:302] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb9435bc66514a4fa61588a5a8fcb082; no voters:
I20260809 01:57:33.320887 15682 leader_election.cc:288] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:33.320974 15687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:33.321187 15687 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [term 1 LEADER]: Becoming Leader. State: Replica: bb9435bc66514a4fa61588a5a8fcb082, State: Running, Role: LEADER
I20260809 01:57:33.321516 15687 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } }
I20260809 01:57:33.322180 15682 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:33.323304 15689 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb9435bc66514a4fa61588a5a8fcb082. Latest consensus state: current_term: 1 leader_uuid: "bb9435bc66514a4fa61588a5a8fcb082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } } }
I20260809 01:57:33.323431 15689 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:33.323748 15688 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb9435bc66514a4fa61588a5a8fcb082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb9435bc66514a4fa61588a5a8fcb082" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40527 } } }
I20260809 01:57:33.323853 15688 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:33.325397 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:33.310948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.14.175.254:40527)
0809 01:57:33.311397 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:33.311412 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:33.311445 (+ 33us) server_negotiation.cc:407] Connection header received
0809 01:57:33.312087 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:33.312103 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:33.312452 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:33.312720 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:33.313470 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.314903 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.315768 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.316466 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.316636 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:33.319285 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:33.319294 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:33.319311 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:33.319346 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:33.321554 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.322132 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.322137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.322142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.322306 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.322659 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.322661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.322663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.323215 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:33.323480 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:33.323777 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 01:57:33.324258 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":123,"threads_started":1}
W20260809 01:57:33.327107 15702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:33.327221 15702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:33.327351 15696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:33.328235 15696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:33.333544 15696 catalog_manager.cc:1347] Generated new cluster ID: d69f44e1a6ac4ae7a7f19eaee5116b01
I20260809 01:57:33.333608 15696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:33.370262 15696 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:33.371366 15696 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:33.376753 15696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb9435bc66514a4fa61588a5a8fcb082: Generated new TSK 0
I20260809 01:57:33.377524 15696 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:33.414386 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:33.522131 15708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:33.522387 15708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:33.522459 15708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:33.526652 15708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:33.526736 15708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:33.526822 15708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:33.531862 15708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:33.532796 15708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:33.533744 15708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:33.542774 15714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.542811 15708 server_base.cc:1034] running on GCE node
W20260809 01:57:33.542768 15715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.542768 15717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.543406 15708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:33.543987 15708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:33.545187 15708 hybrid_clock.cc:648] HybridClock initialized: now 1786240653545179 us; error 29 us; skew 500 ppm
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:33.548010 15708 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:33.548838 15708 webserver.cc:460] Webserver started at http://127.14.175.193:39507/ using document root <none> and password file <none>
I20260809 01:57:33.549358 15708 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:33.549448 15708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:33.549683 15708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:33.551676 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "fbd29fac915343e59d005b051eb8e4c5"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "6c19564fcf7ac8902cff02d5181abc16"
server_key_iv: "3e29d741879660397bb30a666ea0dc45"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.552206 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "fbd29fac915343e59d005b051eb8e4c5"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "6c19564fcf7ac8902cff02d5181abc16"
server_key_iv: "3e29d741879660397bb30a666ea0dc45"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.555608 15708 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:57:33.557890 15724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.559022 15708 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:33.559151 15708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "fbd29fac915343e59d005b051eb8e4c5"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "6c19564fcf7ac8902cff02d5181abc16"
server_key_iv: "3e29d741879660397bb30a666ea0dc45"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.559252 15708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:33.572613 15708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:33.575290 15708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:33.575475 15708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:33.575980 15708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:33.576797 15708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:33.576865 15708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.576933 15708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:33.576987 15708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.585681 15708 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:34435
I20260809 01:57:33.585708 15845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:34435 every 8 connection(s)
I20260809 01:57:33.586488 15708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:33.590497 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15708
I20260809 01:57:33.590613 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:33.590891 15039 external_mini_cluster.cc:1428] Setting key 46337c65e550e2ba06d528ff3230963c
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:33.599555 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:33.588221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:44015 (local address 127.14.175.254:40527)
0809 01:57:33.588354 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:33.588358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:33.589134 (+ 776us) server_negotiation.cc:407] Connection header received
0809 01:57:33.589953 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:33.589956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:33.590003 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:33.590077 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:33.591567 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.592114 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.593232 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.593477 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.593591 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:33.596005 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:33.596009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:33.596012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:33.596034 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:33.597463 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.597976 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.597985 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.597986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.598062 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.598398 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.598402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.598404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.598589 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:33.598699 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:33.599243 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 01:57:33.599370 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:57:33.600329 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:33.588567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40527 (local address 127.14.175.193:44015)
0809 01:57:33.588980 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:33.589024 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:33.589763 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:33.590252 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:33.590263 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:33.590777 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:33.591411 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:33.591428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.592247 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.592256 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:33.593101 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:33.593110 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.593628 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.593632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:33.593795 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:33.594369 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:33.594385 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:33.595834 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:33.597588 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:33.597594 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:33.597607 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:33.597863 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:33.598157 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:33.598160 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:33.598162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:33.598298 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:33.598700 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:33.598709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:33.598941 (+ 232us) client_negotiation.cc:769] Sending connection context
0809 01:57:33.599196 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 01:57:33.599500 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":97,"threads_started":1}
I20260809 01:57:33.601608 15846 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40527
I20260809 01:57:33.601843 15846 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:33.602303 15846 heartbeater.cc:511] Master 127.14.175.254:40527 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:57:33.603909 15643 ts_manager.cc:194] Registered new tserver with Master: fbd29fac915343e59d005b051eb8e4c5 (127.14.175.193:34435)
I20260809 01:57:33.605458 15643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:44015
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:33.617775 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:33.730415 15851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:33.730662 15851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:33.730705 15851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:33.734699 15851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:33.734753 15851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:33.734833 15851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:33.739979 15851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:33.740883 15851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:33.741786 15851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:33.750805 15857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.750883 15859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.750952 15856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.751022 15851 server_base.cc:1034] running on GCE node
I20260809 01:57:33.751478 15851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:33.752092 15851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:33.753273 15851 hybrid_clock.cc:648] HybridClock initialized: now 1786240653753257 us; error 29 us; skew 500 ppm
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:33.756075 15851 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:33.756893 15851 webserver.cc:460] Webserver started at http://127.14.175.194:43967/ using document root <none> and password file <none>
I20260809 01:57:33.757441 15851 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:33.757534 15851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:33.757762 15851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:33.759765 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "9799a701d3c04b94843cea667e656107"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "3903e02a0607b88b4136cf37babfeb4f"
server_key_iv: "970c76250424bb7b1db621ec61c53023"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.760308 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "9799a701d3c04b94843cea667e656107"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "3903e02a0607b88b4136cf37babfeb4f"
server_key_iv: "970c76250424bb7b1db621ec61c53023"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.763954 15851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:57:33.766187 15866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.767422 15851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:33.767553 15851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "9799a701d3c04b94843cea667e656107"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "3903e02a0607b88b4136cf37babfeb4f"
server_key_iv: "970c76250424bb7b1db621ec61c53023"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.767659 15851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:33.777437 15851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:33.780303 15851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:33.780516 15851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:33.781060 15851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:33.781838 15851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:33.781886 15851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.781922 15851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:33.781937 15851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.791379 15851 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:45469
I20260809 01:57:33.791415 15985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:45469 every 8 connection(s)
I20260809 01:57:33.792303 15851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:33.793630 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15851
I20260809 01:57:33.793754 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:33.794059 15039 external_mini_cluster.cc:1428] Setting key 1329ca002c2d92a16b1ce51d9095c165
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:33.807050 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:33.794214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:58909 (local address 127.14.175.254:40527)
0809 01:57:33.794373 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:33.794378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:33.796015 (+ 1637us) server_negotiation.cc:407] Connection header received
0809 01:57:33.796830 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:33.796837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:33.796899 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:33.796992 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:33.798074 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.798612 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.799857 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.800179 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.800306 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:33.803080 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:33.803083 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:33.803085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:33.803107 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:33.804604 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.805136 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.805144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.805146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.805222 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:33.805704 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:33.805707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:33.805709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:33.805910 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:33.806024 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:33.806668 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 01:57:33.806842 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:57:33.807976 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:33.794719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40527 (local address 127.14.175.194:58909)
0809 01:57:33.795875 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:33.795916 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:33.796632 (+ 716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:33.797114 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:33.797119 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:33.797456 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:33.797914 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:33.797927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.798753 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.798757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:33.799711 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:33.799720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:33.800347 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:33.800351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:33.800522 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:33.801158 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:33.801175 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:33.802859 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:33.804723 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:33.804729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:33.804744 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:33.805017 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:33.805336 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:33.805339 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:33.805341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:33.805585 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:33.806025 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:33.806032 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:33.806303 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 01:57:33.806544 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 01:57:33.806864 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"thread_start_us":172,"threads_started":1}
I20260809 01:57:33.809321 15987 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40527
I20260809 01:57:33.809646 15987 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:33.810252 15987 heartbeater.cc:511] Master 127.14.175.254:40527 requested a full tablet report, sending...
I20260809 01:57:33.811471 15643 ts_manager.cc:194] Registered new tserver with Master: 9799a701d3c04b94843cea667e656107 (127.14.175.194:45469)
I20260809 01:57:33.812384 15643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:58909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:33.826709 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:33.938051 15993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:33.938359 15993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:33.938439 15993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:33.942551 15993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:33.942646 15993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:33.942741 15993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:33.948035 15993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40527
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:33.949023 15993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:33.950037 15993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:33.959407 15999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.959448 15998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:33.959420 16001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:33.959653 15993 server_base.cc:1034] running on GCE node
I20260809 01:57:33.960067 15993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:33.960676 15993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:33.961862 15993 hybrid_clock.cc:648] HybridClock initialized: now 1786240653961855 us; error 32 us; skew 500 ppm
Aug 09 01:57:33 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:33.964872 15993 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:33.966022 15993 webserver.cc:460] Webserver started at http://127.14.175.195:38511/ using document root <none> and password file <none>
I20260809 01:57:33.966588 15993 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:33.966694 15993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:33.966928 15993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:33.969419 15993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "33d5bd9c89244e5597d8c5a870294072"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "35d970c9b6e1b533e432b871c48675ea"
server_key_iv: "089d47b886a8d8a163ff91e28424cd7d"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.969921 15993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "33d5bd9c89244e5597d8c5a870294072"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "35d970c9b6e1b533e432b871c48675ea"
server_key_iv: "089d47b886a8d8a163ff91e28424cd7d"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.974062 15993 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 01:57:33.976467 16008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:33.977751 15993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:33.977870 15993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "33d5bd9c89244e5597d8c5a870294072"
format_stamp: "Formatted at 2026-08-09 01:57:33 on dist-test-slave-2w3w"
server_key: "35d970c9b6e1b533e432b871c48675ea"
server_key_iv: "089d47b886a8d8a163ff91e28424cd7d"
server_key_version: "encryptionkey@0"
I20260809 01:57:33.977973 15993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:33.996412 15993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:33.999686 15993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:33.999888 15993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:34.000478 15993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:34.001284 15993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:34.001333 15993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:34.001397 15993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:34.001430 15993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:34.010792 15993 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:43739
I20260809 01:57:34.010826 16124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:43739 every 8 connection(s)
I20260809 01:57:34.011724 15993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:34.013239 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 15993
I20260809 01:57:34.013378 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:34.013692 15039 external_mini_cluster.cc:1428] Setting key 1ff35ae39ccb9f19ce18925beeac5fc0
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:34.025668 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.013609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:36001 (local address 127.14.175.254:40527)
0809 01:57:34.013785 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.013791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.015155 (+ 1364us) server_negotiation.cc:407] Connection header received
0809 01:57:34.016299 (+ 1144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.016302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.016346 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.016412 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:34.017565 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.018111 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.019410 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.019634 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.019711 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.022138 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:34.022141 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:34.022143 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:34.022167 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:34.023844 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.024386 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.024388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.024389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.024464 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.024757 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.024759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.024760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.024927 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:34.025004 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.025438 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.025550 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 01:57:34.026521 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.014033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40527 (local address 127.14.175.195:36001)
0809 01:57:34.014928 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.015026 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.016105 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.016571 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.016577 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.016944 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:34.017440 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.017453 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.018228 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.018231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.019287 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.019297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.019765 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.019768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.019926 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.020449 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:34.020465 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:34.021974 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:34.023955 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:34.023960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:34.023970 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:34.024300 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:34.024551 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:34.024554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:34.024555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:34.024682 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:34.025014 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:34.025019 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:34.025224 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.025386 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.025619 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":151,"threads_started":1}
I20260809 01:57:34.027773 16126 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40527
I20260809 01:57:34.028046 16126 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:34.028519 16126 heartbeater.cc:511] Master 127.14.175.254:40527 requested a full tablet report, sending...
I20260809 01:57:34.029484 15643 ts_manager.cc:194] Registered new tserver with Master: 33d5bd9c89244e5597d8c5a870294072 (127.14.175.195:43739)
I20260809 01:57:34.030040 15643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:36001
I20260809 01:57:34.039422 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:57:34.051237 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.043566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46458 (local address 127.14.175.254:40527)
0809 01:57:34.043694 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.043697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.043828 (+ 131us) server_negotiation.cc:407] Connection header received
0809 01:57:34.043912 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.043915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.043953 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.044023 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:34.044783 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.045363 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.046284 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.046534 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.046656 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.048043 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:34.048047 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:34.048050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:34.048083 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:34.049358 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.049823 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.049827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.049829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.049916 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.050221 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.050226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.050228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.050452 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:34.050607 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.050886 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.051042 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 01:57:34.056630 15643 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:34.060050 15643 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:34.075711 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.069913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58610 (local address 127.14.175.195:43739)
0809 01:57:34.070712 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.070727 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.071110 (+ 383us) server_negotiation.cc:407] Connection header received
0809 01:57:34.071201 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.071207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.071421 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.071707 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:34.072001 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.072916 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.074402 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.075025 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.075166 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.075356 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.075469 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.075562 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":136,"threads_started":1}
I20260809 01:57:34.075713 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.069788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43739 (local address 127.0.0.1:58610)
0809 01:57:34.070406 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.070798 (+ 392us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.070928 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.071665 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.071671 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.071698 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:34.071847 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.071853 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.073057 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.073062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.074268 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.074279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.075147 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.075155 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.075271 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.075320 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.075440 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.075558 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":48,"thread_start_us":83,"threads_started":1}
I20260809 01:57:34.076593 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.070509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34435 (local address 127.0.0.1:48138)
0809 01:57:34.071257 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.071273 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.071395 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.072154 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.072157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.072172 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:34.072273 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.072279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.073744 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.073747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.075077 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.075087 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.076190 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.076194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.076285 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.076309 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.076376 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.076454 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260809 01:57:34.076648 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.070671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48138 (local address 127.14.175.193:34435)
0809 01:57:34.071084 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.071102 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.071509 (+ 407us) server_negotiation.cc:407] Connection header received
0809 01:57:34.071587 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.071591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.071779 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.071943 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:34.072404 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.073598 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.075215 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.076057 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.076206 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.076345 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.076412 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.076498 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":86,"threads_started":1}
I20260809 01:57:34.077374 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.069918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:45469 (local address 127.0.0.1:45108)
0809 01:57:34.071212 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.071226 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.071298 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.071928 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.071934 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.071958 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:34.072050 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.072059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.073560 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.073564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.074939 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.074951 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.076631 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.076636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.077047 (+ 411us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.077086 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.077172 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.077242 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1228,"thread_start_us":95,"threads_started":1}
I20260809 01:57:34.077481 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.070979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.14.175.194:45469)
0809 01:57:34.071469 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.071484 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.071505 (+ 21us) server_negotiation.cc:407] Connection header received
0809 01:57:34.071584 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.071589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.071780 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.071981 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:34.072153 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.073392 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.075109 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.076335 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.076448 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.076563 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.077231 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.077336 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":176,"threads_started":1}
I20260809 01:57:34.079593 15775 tablet_service.cc:1467] Processing CreateTablet for tablet 24d16b81344640329dc5e547d29ba15a (DEFAULT_TABLE table=test-table [id=65c27a466a924afdb1f4af377f100c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:34.079609 16058 tablet_service.cc:1467] Processing CreateTablet for tablet 24d16b81344640329dc5e547d29ba15a (DEFAULT_TABLE table=test-table [id=65c27a466a924afdb1f4af377f100c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:34.080351 15916 tablet_service.cc:1467] Processing CreateTablet for tablet 24d16b81344640329dc5e547d29ba15a (DEFAULT_TABLE table=test-table [id=65c27a466a924afdb1f4af377f100c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:34.080857 16058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d16b81344640329dc5e547d29ba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:34.080860 15775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d16b81344640329dc5e547d29ba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:34.081310 15916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d16b81344640329dc5e547d29ba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:34.088172 16143 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: Bootstrap starting.
I20260809 01:57:34.089038 16145 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: Bootstrap starting.
I20260809 01:57:34.089253 16144 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: Bootstrap starting.
I20260809 01:57:34.090378 16143 tablet_bootstrap.cc:654] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:34.091135 16145 tablet_bootstrap.cc:654] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:34.091652 16144 tablet_bootstrap.cc:654] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:34.091864 16143 log.cc:824] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:34.092432 16144 log.cc:824] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:34.092430 16145 log.cc:824] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:34.094070 16143 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: No bootstrap required, opened a new log
I20260809 01:57:34.094285 16143 ts_tablet_manager.cc:1397] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 01:57:34.094385 16144 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: No bootstrap required, opened a new log
I20260809 01:57:34.094578 16144 ts_tablet_manager.cc:1397] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 01:57:34.094909 16145 tablet_bootstrap.cc:492] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: No bootstrap required, opened a new log
I20260809 01:57:34.095124 16145 ts_tablet_manager.cc:1397] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260809 01:57:34.097519 16143 raft_consensus.cc:348] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.097766 16143 raft_consensus.cc:374] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:34.097834 16143 raft_consensus.cc:729] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd29fac915343e59d005b051eb8e4c5, State: Initialized, Role: FOLLOWER
I20260809 01:57:34.098320 16143 consensus_queue.cc:260] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.098369 16144 raft_consensus.cc:348] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.098646 16144 raft_consensus.cc:374] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:34.098711 16144 raft_consensus.cc:729] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9799a701d3c04b94843cea667e656107, State: Initialized, Role: FOLLOWER
I20260809 01:57:34.098726 16145 raft_consensus.cc:348] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.098996 16145 raft_consensus.cc:374] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:34.099067 16145 raft_consensus.cc:729] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33d5bd9c89244e5597d8c5a870294072, State: Initialized, Role: FOLLOWER
I20260809 01:57:34.099174 16144 consensus_queue.cc:260] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.099375 15846 heartbeater.cc:503] Master 127.14.175.254:40527 was elected leader, sending a full tablet report...
I20260809 01:57:34.099551 16143 ts_tablet_manager.cc:1428] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 01:57:34.100090 16145 consensus_queue.cc:260] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.100181 16144 ts_tablet_manager.cc:1428] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 01:57:34.100649 15987 heartbeater.cc:503] Master 127.14.175.254:40527 was elected leader, sending a full tablet report...
I20260809 01:57:34.101042 16145 ts_tablet_manager.cc:1428] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 01:57:34.101388 16126 heartbeater.cc:503] Master 127.14.175.254:40527 was elected leader, sending a full tablet report...
I20260809 01:57:34.143433 16150 raft_consensus.cc:482] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:34.143623 16150 raft_consensus.cc:504] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.144692 16150 leader_election.cc:288] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33d5bd9c89244e5597d8c5a870294072 (127.14.175.195:43739), fbd29fac915343e59d005b051eb8e4c5 (127.14.175.193:34435)
I20260809 01:57:34.149051 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.144954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34435 (local address 127.14.175.194:51125)
0809 01:57:34.145106 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.145123 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.145245 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.145544 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.145547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.145566 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:34.145719 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.145729 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.146696 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.146699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.147676 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.147686 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.148590 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.148594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.148701 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.148728 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.148819 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.148897 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":21}
I20260809 01:57:34.149085 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.145166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:51125 (local address 127.14.175.193:34435)
0809 01:57:34.145330 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.145334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.145355 (+ 21us) server_negotiation.cc:407] Connection header received
0809 01:57:34.145399 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.145401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.145441 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.145529 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:34.145870 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.146581 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.147802 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.148461 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.148595 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.148659 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.148866 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.148942 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 01:57:34.149390 16152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.144954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43739 (local address 127.14.175.194:40783)
0809 01:57:34.145606 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:34.145619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:34.145711 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:34.145962 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:34.145965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:34.145983 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:34.146103 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.146110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.146858 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.146861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.148096 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:34.148106 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.148900 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.148904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:34.149017 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.149042 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 01:57:34.149131 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 01:57:34.149209 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":285,"thread_start_us":162,"threads_started":1}
I20260809 01:57:34.149655 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.145070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:40783 (local address 127.14.175.195:43739)
0809 01:57:34.145216 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.145224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.145703 (+ 479us) server_negotiation.cc:407] Connection header received
0809 01:57:34.145800 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.145805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.145857 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.145919 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:34.146219 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.146734 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.148213 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.148776 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.148887 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.148931 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.149449 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.149534 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 01:57:34.149910 15796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d16b81344640329dc5e547d29ba15a" candidate_uuid: "9799a701d3c04b94843cea667e656107" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd29fac915343e59d005b051eb8e4c5" is_pre_election: true
I20260809 01:57:34.150261 16078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d16b81344640329dc5e547d29ba15a" candidate_uuid: "9799a701d3c04b94843cea667e656107" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33d5bd9c89244e5597d8c5a870294072" is_pre_election: true
I20260809 01:57:34.150360 15796 raft_consensus.cc:2454] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9799a701d3c04b94843cea667e656107 in term 0.
I20260809 01:57:34.150575 16078 raft_consensus.cc:2454] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9799a701d3c04b94843cea667e656107 in term 0.
I20260809 01:57:34.151021 15870 leader_election.cc:302] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9799a701d3c04b94843cea667e656107, fbd29fac915343e59d005b051eb8e4c5; no voters:
I20260809 01:57:34.151299 16150 raft_consensus.cc:2781] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:34.151378 16150 raft_consensus.cc:482] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:34.151408 16150 raft_consensus.cc:3037] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:34.152491 16150 raft_consensus.cc:504] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.152840 16150 leader_election.cc:288] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [CANDIDATE]: Term 1 election: Requested vote from peers 33d5bd9c89244e5597d8c5a870294072 (127.14.175.195:43739), fbd29fac915343e59d005b051eb8e4c5 (127.14.175.193:34435)
I20260809 01:57:34.153234 16078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d16b81344640329dc5e547d29ba15a" candidate_uuid: "9799a701d3c04b94843cea667e656107" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33d5bd9c89244e5597d8c5a870294072"
I20260809 01:57:34.153245 15796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d16b81344640329dc5e547d29ba15a" candidate_uuid: "9799a701d3c04b94843cea667e656107" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd29fac915343e59d005b051eb8e4c5"
I20260809 01:57:34.153360 16078 raft_consensus.cc:3037] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:34.153360 15796 raft_consensus.cc:3037] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:34.154640 16078 raft_consensus.cc:2454] T 24d16b81344640329dc5e547d29ba15a P 33d5bd9c89244e5597d8c5a870294072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9799a701d3c04b94843cea667e656107 in term 1.
I20260809 01:57:34.154640 15796 raft_consensus.cc:2454] T 24d16b81344640329dc5e547d29ba15a P fbd29fac915343e59d005b051eb8e4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9799a701d3c04b94843cea667e656107 in term 1.
I20260809 01:57:34.155030 15869 leader_election.cc:302] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33d5bd9c89244e5597d8c5a870294072, 9799a701d3c04b94843cea667e656107; no voters:
I20260809 01:57:34.155277 16150 raft_consensus.cc:2781] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:34.155539 16150 raft_consensus.cc:686] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [term 1 LEADER]: Becoming Leader. State: Replica: 9799a701d3c04b94843cea667e656107, State: Running, Role: LEADER
I20260809 01:57:34.155865 16150 consensus_queue.cc:237] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } }
I20260809 01:57:34.159170 15643 catalog_manager.cc:5495] T 24d16b81344640329dc5e547d29ba15a P 9799a701d3c04b94843cea667e656107 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9799a701d3c04b94843cea667e656107 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "9799a701d3c04b94843cea667e656107" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33d5bd9c89244e5597d8c5a870294072" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9799a701d3c04b94843cea667e656107" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbd29fac915343e59d005b051eb8e4c5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34435 } health_report { overall_health: UNKNOWN } } }
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:34.179064 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.170010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.14.175.193:34435)
0809 01:57:34.170185 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.170189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.170271 (+ 82us) server_negotiation.cc:407] Connection header received
0809 01:57:34.170380 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.170383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.170421 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.170489 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:34.171185 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.171774 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.172631 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.172835 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.172909 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.175423 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:34.175433 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:34.175447 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:34.175468 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:34.177155 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.177608 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.177614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.177615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.177706 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.178112 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.178114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.178115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.178348 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:34.178499 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.178722 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.178844 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240654, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240654, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:34.206686 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.198747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48156 (local address 127.14.175.193:34435)
0809 01:57:34.198876 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.198879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.199150 (+ 271us) server_negotiation.cc:407] Connection header received
0809 01:57:34.199229 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.199232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.199275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.199361 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:34.200037 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.200565 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.201354 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.201578 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.201659 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.204061 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:34.204065 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:34.204066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:34.204089 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:34.205313 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.205691 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.205693 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.205695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.205763 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.205993 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.205995 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.205997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.206141 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:34.206235 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.206472 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.206567 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[15598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:34.232811 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:34.224732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48160 (local address 127.14.175.193:34435)
0809 01:57:34.224962 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:34.224967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:34.225103 (+ 136us) server_negotiation.cc:407] Connection header received
0809 01:57:34.225276 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:34.225280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:34.225331 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:34.225419 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:34.226101 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.226604 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.227512 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:34.227736 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:34.227849 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:34.230132 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:34.230135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:34.230137 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:34.230158 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:34.231390 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.231763 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.231766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.231767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.231834 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:34.232080 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:34.232081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:34.232082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:34.232227 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:34.232320 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:34.232513 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 01:57:34.232600 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
W20260809 01:57:34.234458 15754 tablet_service.cc:2908] Rejecting scan request for tablet 24d16b81344640329dc5e547d29ba15a: Uninitialized: clean time has not yet been initialized
I20260809 01:57:34.236801 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15708
I20260809 01:57:34.244114 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15851
I20260809 01:57:34.250484 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15993
I20260809 01:57:34.256745 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 15611
2026-08-09T01:57:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2342 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[16168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[16168](info): set up 2 sockets
Aug 09 01:57:34 dist-test-slave-2w3w krb5kdc[16168](info): commencing operation
krb5kdc: starting...
W20260809 01:57:35.325140 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:35 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:35.449507 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37141
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:34561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:37141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:35.558864 16181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:35.559208 16181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:35.559295 16181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:35.563292 16181 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:35.563364 16181 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 01:57:35.563395 16181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:35.563454 16181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:35.563516 16181 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:35.563565 16181 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:35.568827 16181 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:34561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:37141
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:35.569818 16181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:35.570822 16181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:35.579058 16187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:35.579058 16188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:35.579226 16190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:35.579281 16181 server_base.cc:1034] running on GCE node
I20260809 01:57:35.579962 16181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:35.580932 16181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:35.582091 16181 hybrid_clock.cc:648] HybridClock initialized: now 1786240655582066 us; error 36 us; skew 500 ppm
Aug 09 01:57:35 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:35.588670 16181 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:35.589625 16181 webserver.cc:460] Webserver started at http://127.14.175.254:42291/ using document root <none> and password file <none>
I20260809 01:57:35.590174 16181 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:35.590235 16181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:35.590467 16181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:35.592581 16181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "e7b995d200ac49399428a6020f7f5998"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "e88edc5fccf20c0657c04020fe134904"
server_key_iv: "0b2d688f01d86db897df208e8d10fa08"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.593150 16181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "e7b995d200ac49399428a6020f7f5998"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "e88edc5fccf20c0657c04020fe134904"
server_key_iv: "0b2d688f01d86db897df208e8d10fa08"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.597177 16181 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 01:57:35.599550 16197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:35.600765 16181 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:35.600909 16181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "e7b995d200ac49399428a6020f7f5998"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "e88edc5fccf20c0657c04020fe134904"
server_key_iv: "0b2d688f01d86db897df208e8d10fa08"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.601023 16181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:35.620191 16181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:35.623474 16181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:35.623692 16181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:35.632467 16181 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:37141
I20260809 01:57:35.632493 16262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:37141 every 8 connection(s)
I20260809 01:57:35.633404 16181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:35.635533 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16181
I20260809 01:57:35.635665 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:35.635908 15039 external_mini_cluster.cc:1428] Setting key c2a4f675e6d8262c7dea6a0ad439632e
I20260809 01:57:35.636245 16263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:35.643375 16263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Bootstrap starting.
Aug 09 01:57:35 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:35.645537 16263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:35.646247 16263 log.cc:824] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:35.648012 16263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: No bootstrap required, opened a new log
I20260809 01:57:35.650843 16263 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } }
I20260809 01:57:35.651131 16263 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:35.651175 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:35.637313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34610 (local address 127.14.175.254:37141)
0809 01:57:35.637757 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:35.637788 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:35.637829 (+ 41us) server_negotiation.cc:407] Connection header received
0809 01:57:35.638581 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:35.638603 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:35.639040 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:35.639406 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:35.640056 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.641567 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.642421 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.643126 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.643285 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:35.645721 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:35.645726 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:35.645738 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:35.645764 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:35.648331 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.648785 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.648790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.648794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.648901 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.649238 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.649241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.649243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.649634 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:35.649844 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:35.650134 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 01:57:35.650396 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":125,"threads_started":1}
I20260809 01:57:35.651211 16263 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b995d200ac49399428a6020f7f5998, State: Initialized, Role: FOLLOWER
I20260809 01:57:35.651623 16263 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } }
I20260809 01:57:35.651773 16263 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:35.651863 16263 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:35.651979 16263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:35.653005 16263 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } }
I20260809 01:57:35.653357 16263 leader_election.cc:302] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7b995d200ac49399428a6020f7f5998; no voters:
I20260809 01:57:35.653666 16263 leader_election.cc:288] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:35.653784 16268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:35.654022 16268 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [term 1 LEADER]: Becoming Leader. State: Replica: e7b995d200ac49399428a6020f7f5998, State: Running, Role: LEADER
I20260809 01:57:35.654305 16268 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } }
I20260809 01:57:35.654810 16263 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:35.655998 16271 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7b995d200ac49399428a6020f7f5998. Latest consensus state: current_term: 1 leader_uuid: "e7b995d200ac49399428a6020f7f5998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } } }
I20260809 01:57:35.656158 16271 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:35.655994 16269 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7b995d200ac49399428a6020f7f5998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b995d200ac49399428a6020f7f5998" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37141 } } }
I20260809 01:57:35.656303 16269 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:35.657568 16279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:35.660483 16279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:35.665876 16279 catalog_manager.cc:1347] Generated new cluster ID: e26e25ed812a495ea1ebe295e0935ca4
I20260809 01:57:35.665947 16279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:35.697430 16279 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:35.698462 16279 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:35.707003 16279 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Generated new TSK 0
I20260809 01:57:35.707703 16279 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:35.742067 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37141
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:34561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:35.877105 16291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:35.877336 16291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:35.877377 16291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:35.881320 16291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:35.881369 16291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:35.881404 16291 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:35.881434 16291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:35.886651 16291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:34561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:37141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:35.887550 16291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:35.888499 16291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:35.897733 16297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:35.897748 16296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:35.897743 16299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:35.897984 16291 server_base.cc:1034] running on GCE node
I20260809 01:57:35.898453 16291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:35.899169 16291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:35.900334 16291 hybrid_clock.cc:648] HybridClock initialized: now 1786240655900316 us; error 29 us; skew 500 ppm
Aug 09 01:57:35 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:35.903239 16291 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:35.904232 16291 webserver.cc:460] Webserver started at http://127.14.175.193:36021/ using document root <none> and password file <none>
I20260809 01:57:35.904763 16291 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:35.904881 16291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:35.905102 16291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:35.907068 16291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "26c702d3eff547dc8b44f2b18a4f42c3"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "f937ee7404149fbf678af2b7d5e0bc24"
server_key_iv: "90c8f0059fe5ccd5bc3352e31689e2d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.907630 16291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "26c702d3eff547dc8b44f2b18a4f42c3"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "f937ee7404149fbf678af2b7d5e0bc24"
server_key_iv: "90c8f0059fe5ccd5bc3352e31689e2d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.911139 16291 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 01:57:35.913362 16306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:35.914424 16291 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:35.914553 16291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "26c702d3eff547dc8b44f2b18a4f42c3"
format_stamp: "Formatted at 2026-08-09 01:57:35 on dist-test-slave-2w3w"
server_key: "f937ee7404149fbf678af2b7d5e0bc24"
server_key_iv: "90c8f0059fe5ccd5bc3352e31689e2d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:35.914656 16291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:35.927305 16291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:35.929899 16291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:35.930094 16291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:35.931550 16291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:35.931624 16291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:35.931682 16291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:35.931720 16291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:35 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:35.942358 16291 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:33055
I20260809 01:57:35.942459 16427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:33055 every 8 connection(s)
I20260809 01:57:35.943289 16291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:35.945555 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:35.932258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:53589 (local address 127.14.175.254:37141)
0809 01:57:35.932443 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:35.932450 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:35.933737 (+ 1287us) server_negotiation.cc:407] Connection header received
0809 01:57:35.935179 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:35.935182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:35.935229 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:35.935304 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:35.936977 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.937538 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.938830 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.939177 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.939279 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:35.941879 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:35.941882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:35.941885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:35.941917 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:35.943584 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.944190 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.944194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.944196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.944288 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.944605 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.944607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.944608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.944778 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:35.944867 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:35.945325 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 01:57:35.945438 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 01:57:35.946204 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:35.933083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.193:53589)
0809 01:57:35.933571 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:35.933633 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:35.934912 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:35.935528 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:35.935540 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:35.936054 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:35.936795 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:35.936818 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.937676 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.937679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:35.938690 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:35.938700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.939318 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.939322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:35.939487 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:35.940110 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:35.940126 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:35.941709 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:35.943700 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:35.943706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:35.943720 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:35.944082 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:35.944381 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:35.944383 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:35.944384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:35.944517 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:35.944869 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:35.944873 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:35.945072 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 01:57:35.945216 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 01:57:35.945437 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":111,"threads_started":1}
I20260809 01:57:35.947458 16428 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37141
I20260809 01:57:35.947635 16428 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:35.948169 16428 heartbeater.cc:511] Master 127.14.175.254:37141 requested a full tablet report, sending...
I20260809 01:57:35.949497 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16291
I20260809 01:57:35.949636 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:35.949755 16213 ts_manager.cc:194] Registered new tserver with Master: 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055)
I20260809 01:57:35.949930 15039 external_mini_cluster.cc:1428] Setting key d31dc45e2e3eb5954da0d89dffca960e
I20260809 01:57:35.951188 16213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:53589
I20260809 01:57:35.957929 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:35.949723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.193:46725)
0809 01:57:35.950084 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:35.950100 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:35.950186 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:35.950407 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:35.950410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:35.950619 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:35.950739 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:35.950746 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.951749 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.951753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:35.952614 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:35.952625 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.953312 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.953316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:35.953404 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:35.953890 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:35.953904 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:35.954213 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:35.956348 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:35.956350 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:35.956352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:35.956613 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:35.956940 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:35.956943 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:35.956944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:35.957066 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:35.957541 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:35.957543 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:35.957615 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 01:57:35.957694 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 01:57:35.957793 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":104,"threads_started":1}
I20260809 01:57:35.958159 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:35.950081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:46725 (local address 127.14.175.254:37141)
0809 01:57:35.950194 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:35.950198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:35.950213 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:35.950257 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:35.950260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:35.950298 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:35.950393 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:35.950874 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.951621 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.952757 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:35.953096 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:35.953170 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:35.954352 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:35.954355 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:35.954358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:35.954381 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:35.956241 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.956716 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.956719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.956721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.956842 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:35.957174 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:35.957180 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:35.957185 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:35.957433 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:35.957543 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:35.957787 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 01:57:35.957928 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:35.979971 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37141
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:34561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:36.088641 16437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:36.088888 16437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:36.088963 16437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:36.092888 16437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:36.092944 16437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:36.093017 16437 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:36.093104 16437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:36.098317 16437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:34561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:37141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:36.099464 16437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:36.100433 16437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:36.110306 16442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:36.110309 16443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:36.110432 16437 server_base.cc:1034] running on GCE node
W20260809 01:57:36.110595 16445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:36.111011 16437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:36.111603 16437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:36.112790 16437 hybrid_clock.cc:648] HybridClock initialized: now 1786240656112776 us; error 32 us; skew 500 ppm
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:36.115501 16437 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:36.116278 16437 webserver.cc:460] Webserver started at http://127.14.175.194:38455/ using document root <none> and password file <none>
I20260809 01:57:36.116809 16437 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:36.116900 16437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:36.117122 16437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:36.119190 16437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "c70fefc34d3f5caa5f887e6b4892b64a"
server_key_iv: "4766452706888d84e17ac2e1348ac97e"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.119745 16437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "c70fefc34d3f5caa5f887e6b4892b64a"
server_key_iv: "4766452706888d84e17ac2e1348ac97e"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.123185 16437 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:36.125448 16452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:36.126711 16437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:36.126804 16437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "c70fefc34d3f5caa5f887e6b4892b64a"
server_key_iv: "4766452706888d84e17ac2e1348ac97e"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.126931 16437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:36.138607 16437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:36.141705 16437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:36.141899 16437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:36.143319 16437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:36.143368 16437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:36.143429 16437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:36.143461 16437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:36.154217 16437 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:43049
I20260809 01:57:36.154306 16578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:43049 every 8 connection(s)
I20260809 01:57:36.155268 16437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:36.156710 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16437
I20260809 01:57:36.156832 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:36.157058 15039 external_mini_cluster.cc:1428] Setting key ed25c5e96715768075a2544162b89c60
I20260809 01:57:36.158306 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.144206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:44891 (local address 127.14.175.254:37141)
0809 01:57:36.144347 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.144351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.145343 (+ 992us) server_negotiation.cc:407] Connection header received
0809 01:57:36.146470 (+ 1127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.146476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.146543 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.146613 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:36.148499 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.149410 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.151149 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.151469 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.151587 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.154304 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:36.154317 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:36.154323 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:36.154357 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:36.156089 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.156698 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.156701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.156703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.156801 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.157152 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.157157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.157161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.157358 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:36.157468 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.158012 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.158140 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 01:57:36.159073 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.144715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.194:44891)
0809 01:57:36.145182 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.145222 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.146199 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.147064 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.147074 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.147582 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:36.148298 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.148324 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.149555 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.149560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.151015 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.151026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.151622 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.151627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.151802 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.152398 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:36.152417 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:36.154138 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:36.156206 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.156211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.156223 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.156582 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.156881 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.156885 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.156887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.157058 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.157468 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:36.157474 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:36.157768 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.157953 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.158250 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":144,"threads_started":1}
I20260809 01:57:36.160285 16579 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37141
I20260809 01:57:36.160449 16579 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:36.161024 16579 heartbeater.cc:511] Master 127.14.175.254:37141 requested a full tablet report, sending...
I20260809 01:57:36.162111 16214 ts_manager.cc:194] Registered new tserver with Master: 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049)
I20260809 01:57:36.162887 16214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:44891
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:36.170394 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.162417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.194:43401)
0809 01:57:36.162727 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.162744 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.162832 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.163107 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.163111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.163334 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:36.163489 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.163501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.164364 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.164367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.165444 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.165458 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.166034 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.166038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.166153 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.166618 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:36.166637 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:36.167109 (+ 472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:36.169026 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.169029 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.169030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.169210 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.169505 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.169508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.169510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.169608 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.170014 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:36.170016 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:36.170088 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.170170 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.170267 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":106,"threads_started":1}
I20260809 01:57:36.170547 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.162730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:43401 (local address 127.14.175.254:37141)
0809 01:57:36.162830 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.162834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.162847 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:57:36.162937 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.162942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.163005 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.163083 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:36.163637 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.164226 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.165609 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.165910 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.165990 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.167258 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:36.167262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:36.167264 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:36.167289 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:36.168925 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.169298 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.169301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.169302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.169407 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.169702 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.169704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.169705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.169922 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:36.169998 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.170270 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.170369 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:36.186188 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37141
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:34561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:36.294744 16588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:36.295040 16588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:36.295100 16588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:36.299036 16588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:36.299095 16588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:36.299132 16588 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:36.299163 16588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:36.304291 16588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:34561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:37141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:36.305286 16588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:36.306309 16588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:36.315861 16595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:36.315934 16594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:36.315944 16597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:36.316176 16588 server_base.cc:1034] running on GCE node
I20260809 01:57:36.316545 16588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:36.317142 16588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:36.318344 16588 hybrid_clock.cc:648] HybridClock initialized: now 1786240656318327 us; error 26 us; skew 500 ppm
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:36.321229 16588 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:36.322166 16588 webserver.cc:460] Webserver started at http://127.14.175.195:43029/ using document root <none> and password file <none>
I20260809 01:57:36.322754 16588 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:36.322863 16588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:36.323141 16588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:36.325263 16588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "0a4166358f16425cae4c206ab6d7698a"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "93abe449a1cb097a79ca7b3dc7452138"
server_key_iv: "f0602f0c8d49fd16cecafb37fbd4eacf"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.325878 16588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "0a4166358f16425cae4c206ab6d7698a"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "93abe449a1cb097a79ca7b3dc7452138"
server_key_iv: "f0602f0c8d49fd16cecafb37fbd4eacf"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.329697 16588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 01:57:36.332268 16604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:36.333468 16588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:36.333621 16588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "0a4166358f16425cae4c206ab6d7698a"
format_stamp: "Formatted at 2026-08-09 01:57:36 on dist-test-slave-2w3w"
server_key: "93abe449a1cb097a79ca7b3dc7452138"
server_key_iv: "f0602f0c8d49fd16cecafb37fbd4eacf"
server_key_version: "encryptionkey@0"
I20260809 01:57:36.333735 16588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:36.347811 16588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:36.350646 16588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:36.350854 16588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:36.352434 16588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:36.352509 16588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:36.352579 16588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:36.352640 16588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:36.364989 16588 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:39025
I20260809 01:57:36.365053 16736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:39025 every 8 connection(s)
I20260809 01:57:36.365945 16588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:36.367389 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.353124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:50117 (local address 127.14.175.254:37141)
0809 01:57:36.353305 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.353312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.354484 (+ 1172us) server_negotiation.cc:407] Connection header received
0809 01:57:36.355713 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.355718 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.355802 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.355942 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:36.357392 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.358311 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.359618 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.359964 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.360104 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.363298 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:36.363301 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:36.363304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:36.363339 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:36.365014 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.365568 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.365572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.365574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.365668 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.366025 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.366028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.366030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.366217 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:36.366329 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.367124 (+ 795us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.367233 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 01:57:36.367954 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.353886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.195:50117)
0809 01:57:36.354339 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.354388 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.355462 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.356112 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.356121 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.356507 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:36.357206 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.357228 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.358472 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.358475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.359481 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.359491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.360153 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.360158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.360412 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.361156 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:36.361186 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:36.363133 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:36.365177 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.365183 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.365195 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.365444 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.365766 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.365770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.365772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.365910 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.366328 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:36.366334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:36.366593 (+ 259us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.366791 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.367109 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":134,"threads_started":1}
I20260809 01:57:36.369050 16737 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37141
I20260809 01:57:36.369201 16737 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:36.369668 16737 heartbeater.cc:511] Master 127.14.175.254:37141 requested a full tablet report, sending...
I20260809 01:57:36.370646 16213 ts_manager.cc:194] Registered new tserver with Master: 0a4166358f16425cae4c206ab6d7698a (127.14.175.195:39025)
I20260809 01:57:36.371366 16213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:50117
I20260809 01:57:36.372413 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16588
I20260809 01:57:36.372560 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:36.372905 15039 external_mini_cluster.cc:1428] Setting key b981ce638be1235053e05117ed6f0b12
I20260809 01:57:36.374926 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:57:36.379041 16743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.371362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.14.175.195:45319)
0809 01:57:36.371674 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.371693 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.371813 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.372078 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.372081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.372345 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:36.372539 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.372561 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.373551 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.373554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.374380 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.374389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.374910 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.374913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.375053 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.375476 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:36.375492 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:36.375932 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:36.377537 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.377542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.377544 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.377733 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.378037 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:36.378041 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:36.378043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:36.378128 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:36.378493 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:36.378495 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:36.378587 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.378692 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.378825 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":2,"thread_start_us":99,"threads_started":1}
I20260809 01:57:36.379070 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.371474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:45319 (local address 127.14.175.254:37141)
0809 01:57:36.371589 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.371593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.371768 (+ 175us) server_negotiation.cc:407] Connection header received
0809 01:57:36.371901 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.371905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.371955 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.372048 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:36.372693 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.373421 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.374495 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.374778 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.374884 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.376075 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:36.376078 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:36.376080 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:36.376104 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:36.377425 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.377868 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.377876 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.377877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.377943 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.378219 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.378224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.378226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.378396 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:36.378501 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.378754 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.378864 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 01:57:36 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:36.402189 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.394202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.14.175.254:37141)
0809 01:57:36.394324 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.394328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.394339 (+ 11us) server_negotiation.cc:407] Connection header received
0809 01:57:36.394373 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.394376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.394410 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.394479 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:36.395239 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.395744 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.396519 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.396726 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.396852 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.399238 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:36.399240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:36.399242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:36.399267 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:36.400712 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.401088 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.401090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.401092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.401164 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:36.401392 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:36.401394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:36.401395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:36.401551 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:36.401650 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.401884 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.401993 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:57:36.405160 16213 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:36.408409 16213 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:36.422348 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.416635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.14.175.195:39025)
0809 01:57:36.417049 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.417063 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.417089 (+ 26us) server_negotiation.cc:407] Connection header received
0809 01:57:36.417167 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.417172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.417377 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.417549 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:36.418032 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.419292 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.420996 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.421666 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.421828 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.421973 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.422102 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.422192 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":108,"threads_started":1}
I20260809 01:57:36.422336 16755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.416440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:39025 (local address 127.0.0.1:39764)
0809 01:57:36.416802 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.416864 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.416985 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.417725 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.417733 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.417758 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:36.417889 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.417896 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.419401 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.419404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.420859 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.420869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.421792 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.421796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.421907 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.421950 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.422068 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.422192 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":30,"thread_start_us":97,"threads_started":1}
I20260809 01:57:36.422504 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.417246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37728 (local address 127.14.175.194:43049)
0809 01:57:36.417755 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.417775 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.418008 (+ 233us) server_negotiation.cc:407] Connection header received
0809 01:57:36.418213 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.418217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.418350 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.418513 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:36.418764 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.419897 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.421367 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.421902 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.422066 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.422187 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.422242 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.422322 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":131,"threads_started":1}
I20260809 01:57:36.422937 16758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.416834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:43049 (local address 127.0.0.1:37728)
0809 01:57:36.417915 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.417930 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.418069 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.418505 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.418508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.418525 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:36.418638 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.418645 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.420030 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.420034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.421247 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.421255 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.422037 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.422041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.422133 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.422156 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.422222 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.422291 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":72,"thread_start_us":98,"threads_started":1}
I20260809 01:57:36.424290 16759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.417196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:33055 (local address 127.0.0.1:47414)
0809 01:57:36.417915 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.417930 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.418018 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.418653 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.418655 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.418673 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:36.418779 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.418785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.420033 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.420038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.421234 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.421245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.423890 (+ 2645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.423894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.423993 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.424015 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.424101 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.424169 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":68,"thread_start_us":75,"threads_started":1}
I20260809 01:57:36.424705 16761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.417614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47414 (local address 127.14.175.193:33055)
0809 01:57:36.418225 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.418239 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.418260 (+ 21us) server_negotiation.cc:407] Connection header received
0809 01:57:36.418331 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.418335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.418531 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.418671 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:36.418911 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.419889 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.422678 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.423529 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.423681 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.423820 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.424462 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.424560 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":94,"threads_started":1}
I20260809 01:57:36.425346 16656 tablet_service.cc:1467] Processing CreateTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (DEFAULT_TABLE table=test-table [id=fd8e5672a4724f01b8fffb519ac0a187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.425474 16506 tablet_service.cc:1467] Processing CreateTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (DEFAULT_TABLE table=test-table [id=fd8e5672a4724f01b8fffb519ac0a187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.426317 16506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95656ffddbf04f88bc3e2d3a9cf3d260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.426321 16656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95656ffddbf04f88bc3e2d3a9cf3d260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.429106 16359 tablet_service.cc:1467] Processing CreateTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (DEFAULT_TABLE table=test-table [id=fd8e5672a4724f01b8fffb519ac0a187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.430083 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95656ffddbf04f88bc3e2d3a9cf3d260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.433683 16762 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Bootstrap starting.
I20260809 01:57:36.435760 16762 tablet_bootstrap.cc:654] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.436534 16762 log.cc:824] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:36.436720 16763 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Bootstrap starting.
I20260809 01:57:36.437554 16765 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Bootstrap starting.
I20260809 01:57:36.439303 16763 tablet_bootstrap.cc:654] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.439577 16765 tablet_bootstrap.cc:654] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.440116 16763 log.cc:824] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:36.440263 16765 log.cc:824] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:36.440773 16762 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: No bootstrap required, opened a new log
I20260809 01:57:36.440982 16762 ts_tablet_manager.cc:1397] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 01:57:36.442044 16763 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: No bootstrap required, opened a new log
I20260809 01:57:36.442221 16763 ts_tablet_manager.cc:1397] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260809 01:57:36.444949 16762 raft_consensus.cc:348] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.445214 16762 raft_consensus.cc:374] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.445272 16762 raft_consensus.cc:729] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfdc9b92ceb4e09a06a9bcdadf06351, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.445714 16762 consensus_queue.cc:260] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.446022 16765 tablet_bootstrap.cc:492] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: No bootstrap required, opened a new log
I20260809 01:57:36.445960 16763 raft_consensus.cc:348] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.446201 16765 ts_tablet_manager.cc:1397] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260809 01:57:36.446209 16763 raft_consensus.cc:374] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.446257 16763 raft_consensus.cc:729] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4166358f16425cae4c206ab6d7698a, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.446555 16579 heartbeater.cc:503] Master 127.14.175.254:37141 was elected leader, sending a full tablet report...
I20260809 01:57:36.446718 16762 ts_tablet_manager.cc:1428] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 01:57:36.446832 16763 consensus_queue.cc:260] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.447496 16737 heartbeater.cc:503] Master 127.14.175.254:37141 was elected leader, sending a full tablet report...
I20260809 01:57:36.447842 16763 ts_tablet_manager.cc:1428] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 01:57:36.449990 16765 raft_consensus.cc:348] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.450250 16765 raft_consensus.cc:374] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.450312 16765 raft_consensus.cc:729] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c702d3eff547dc8b44f2b18a4f42c3, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.450714 16765 consensus_queue.cc:260] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.451344 16428 heartbeater.cc:503] Master 127.14.175.254:37141 was elected leader, sending a full tablet report...
I20260809 01:57:36.451676 16765 ts_tablet_manager.cc:1428] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260809 01:57:36.501003 16769 raft_consensus.cc:482] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:36.501209 16769 raft_consensus.cc:504] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.502391 16769 leader_election.cc:288] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055), 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049)
I20260809 01:57:36.506350 16761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.502765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:37309 (local address 127.14.175.193:33055)
0809 01:57:36.502928 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.502933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.503196 (+ 263us) server_negotiation.cc:407] Connection header received
0809 01:57:36.503335 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.503337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.503378 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.503462 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:36.503749 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.504264 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.505343 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.505750 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.505884 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.505950 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.506157 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.506231 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:57:36.506363 16771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.502689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:33055 (local address 127.14.175.195:37309)
0809 01:57:36.503099 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.503110 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.503222 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.503472 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.503475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.503490 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:36.503635 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.503640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.504395 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.504398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.505208 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.505217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.505876 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.505880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.506010 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.506036 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.506139 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.506215 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":148,"threads_started":1}
I20260809 01:57:36.507198 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95656ffddbf04f88bc3e2d3a9cf3d260" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" is_pre_election: true
I20260809 01:57:36.507304 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.502665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:43049 (local address 127.14.175.195:40587)
0809 01:57:36.502826 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:36.502843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:36.502940 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:36.503290 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:36.503294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:36.503312 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:36.503440 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.503445 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.504303 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.504309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.506037 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:36.506046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.506858 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.506865 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:36.506997 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.507022 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 01:57:36.507103 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 01:57:36.507169 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 01:57:36.507313 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.502869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:40587 (local address 127.14.175.194:43049)
0809 01:57:36.503066 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.503070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.503083 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:57:36.503138 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.503140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.503178 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.503277 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:36.503577 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.504167 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.506160 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.506722 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.506857 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.506909 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.507130 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.507205 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 01:57:36.507544 16379 raft_consensus.cc:2454] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 0.
I20260809 01:57:36.507925 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95656ffddbf04f88bc3e2d3a9cf3d260" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" is_pre_election: true
I20260809 01:57:36.508093 16607 leader_election.cc:302] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4166358f16425cae4c206ab6d7698a, 26c702d3eff547dc8b44f2b18a4f42c3; no voters:
I20260809 01:57:36.508206 16529 raft_consensus.cc:2454] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 0.
I20260809 01:57:36.508410 16769 raft_consensus.cc:2781] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:36.508502 16769 raft_consensus.cc:482] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:36.508556 16769 raft_consensus.cc:3037] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.509660 16769 raft_consensus.cc:504] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.509964 16769 leader_election.cc:288] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 election: Requested vote from peers 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055), 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049)
I20260809 01:57:36.510257 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95656ffddbf04f88bc3e2d3a9cf3d260" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c702d3eff547dc8b44f2b18a4f42c3"
I20260809 01:57:36.510360 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95656ffddbf04f88bc3e2d3a9cf3d260" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
I20260809 01:57:36.510403 16379 raft_consensus.cc:3037] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.510522 16529 raft_consensus.cc:3037] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.511667 16379 raft_consensus.cc:2454] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 1.
I20260809 01:57:36.512495 16529 raft_consensus.cc:2454] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 1.
I20260809 01:57:36.512842 16608 leader_election.cc:302] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4166358f16425cae4c206ab6d7698a, 0dfdc9b92ceb4e09a06a9bcdadf06351; no voters:
I20260809 01:57:36.513023 16769 raft_consensus.cc:2781] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:36.513216 16769 raft_consensus.cc:686] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 1 LEADER]: Becoming Leader. State: Replica: 0a4166358f16425cae4c206ab6d7698a, State: Running, Role: LEADER
I20260809 01:57:36.513528 16769 consensus_queue.cc:237] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } }
I20260809 01:57:36.516438 16213 catalog_manager.cc:5495] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4166358f16425cae4c206ab6d7698a (127.14.175.195). New cstate: current_term: 1 leader_uuid: "0a4166358f16425cae4c206ab6d7698a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } health_report { overall_health: UNKNOWN } } }
I20260809 01:57:36.550442 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:36.546079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39776 (local address 127.14.175.195:39025)
0809 01:57:36.546220 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:36.546224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:36.546239 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:36.546476 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:36.546478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:36.546539 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:36.546644 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:36.546925 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.547532 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.548917 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:36.549145 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:36.549257 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:36.549611 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:36.550025 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:36.550167 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:36.550245 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 01:57:36.550299 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 01:57:36.556298 16379 raft_consensus.cc:1261] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Refusing update from remote peer 0a4166358f16425cae4c206ab6d7698a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:36.557067 16772 consensus_queue.cc:1035] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:36.558068 16529 raft_consensus.cc:1261] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Refusing update from remote peer 0a4166358f16425cae4c206ab6d7698a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:36.558677 16772 consensus_queue.cc:1035] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:36.564230 16777 mvcc.cc:205] Tried to move back new op lower bound from 7316441729246273536 to 7316441729081839616. Current Snapshot: MvccSnapshot[applied={T|T < 7316441729246273536}]
I20260809 01:57:36.578712 16213 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:36.579005 16213 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:36.581733 16213 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Sending DeleteTablet for 3 replicas of tablet 95656ffddbf04f88bc3e2d3a9cf3d260
I20260809 01:57:36.582603 16359 tablet_service.cc:1514] Processing DeleteTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:36 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47414
I20260809 01:57:36.582652 16506 tablet_service.cc:1514] Processing DeleteTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:36 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:37728
I20260809 01:57:36.583185 16787 tablet_replica.cc:330] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: stopping tablet replica
I20260809 01:57:36.583346 16213 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 01:57:36.583388 16656 tablet_service.cc:1514] Processing DeleteTablet for tablet 95656ffddbf04f88bc3e2d3a9cf3d260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:36 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:39764
I20260809 01:57:36.583482 16787 raft_consensus.cc:2229] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:36.583468 16788 tablet_replica.cc:330] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: stopping tablet replica
W20260809 01:57:36.583747 16213 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:36.583770 16787 raft_consensus.cc:2258] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:36.584167 16788 raft_consensus.cc:2229] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:36.584543 16788 raft_consensus.cc:2258] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:36.585141 16789 tablet_replica.cc:330] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: stopping tablet replica
I20260809 01:57:36.585232 16787 ts_tablet_manager.cc:1905] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:36.585492 16789 raft_consensus.cc:2229] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:36.585899 16789 raft_consensus.cc:2258] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:36.587132 16789 ts_tablet_manager.cc:1905] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:36.588443 16787 ts_tablet_manager.cc:1918] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:57:36.588543 16787 log.cc:1196] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/95656ffddbf04f88bc3e2d3a9cf3d260
I20260809 01:57:36.588917 16787 ts_tablet_manager.cc:1939] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting consensus metadata
I20260809 01:57:36.589748 16359 tablet_service.cc:1467] Processing CreateTablet for tablet efd516d907c14e5f84f497a74572edc1 (DEFAULT_TABLE table=test-table [id=4ff673cadf24482284b58fab12a5a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.589994 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd516d907c14e5f84f497a74572edc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.589988 16789 ts_tablet_manager.cc:1918] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:57:36.590060 16200 catalog_manager.cc:4841] TS 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055): tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (table test-table [id=fd8e5672a4724f01b8fffb519ac0a187]) successfully deleted
I20260809 01:57:36.590271 16789 log.cc:1196] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/95656ffddbf04f88bc3e2d3a9cf3d260
I20260809 01:57:36.590593 16506 tablet_service.cc:1467] Processing CreateTablet for tablet efd516d907c14e5f84f497a74572edc1 (DEFAULT_TABLE table=test-table [id=4ff673cadf24482284b58fab12a5a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.590747 16789 ts_tablet_manager.cc:1939] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0a4166358f16425cae4c206ab6d7698a: Deleting consensus metadata
I20260809 01:57:36.590915 16506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd516d907c14e5f84f497a74572edc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.592178 16765 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Bootstrap starting.
I20260809 01:57:36.592422 16200 catalog_manager.cc:4841] TS 0a4166358f16425cae4c206ab6d7698a (127.14.175.195:39025): tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (table test-table [id=fd8e5672a4724f01b8fffb519ac0a187]) successfully deleted
I20260809 01:57:36.593083 16765 tablet_bootstrap.cc:654] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.593238 16762 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Bootstrap starting.
I20260809 01:57:36.593416 16656 tablet_service.cc:1467] Processing CreateTablet for tablet efd516d907c14e5f84f497a74572edc1 (DEFAULT_TABLE table=test-table [id=4ff673cadf24482284b58fab12a5a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:36.593649 16656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd516d907c14e5f84f497a74572edc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:36.594198 16762 tablet_bootstrap.cc:654] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.595489 16762 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: No bootstrap required, opened a new log
I20260809 01:57:36.595574 16762 ts_tablet_manager.cc:1397] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:36.596079 16763 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Bootstrap starting.
I20260809 01:57:36.596092 16762 raft_consensus.cc:348] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.596215 16762 raft_consensus.cc:374] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.596252 16762 raft_consensus.cc:729] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfdc9b92ceb4e09a06a9bcdadf06351, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.596379 16762 consensus_queue.cc:260] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.596647 16762 ts_tablet_manager.cc:1428] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:36.596961 16763 tablet_bootstrap.cc:654] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:36.597875 16765 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: No bootstrap required, opened a new log
I20260809 01:57:36.597934 16765 ts_tablet_manager.cc:1397] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260809 01:57:36.598366 16788 ts_tablet_manager.cc:1905] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:36.598591 16765 raft_consensus.cc:348] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.598670 16765 raft_consensus.cc:374] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.598690 16765 raft_consensus.cc:729] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c702d3eff547dc8b44f2b18a4f42c3, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.598826 16765 consensus_queue.cc:260] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.599093 16765 ts_tablet_manager.cc:1428] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:36.600656 16763 tablet_bootstrap.cc:492] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: No bootstrap required, opened a new log
I20260809 01:57:36.600739 16763 ts_tablet_manager.cc:1397] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:57:36.600765 16788 ts_tablet_manager.cc:1918] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:57:36.600844 16788 log.cc:1196] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/95656ffddbf04f88bc3e2d3a9cf3d260
I20260809 01:57:36.601128 16788 ts_tablet_manager.cc:1939] T 95656ffddbf04f88bc3e2d3a9cf3d260 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting consensus metadata
I20260809 01:57:36.601229 16763 raft_consensus.cc:348] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.601332 16763 raft_consensus.cc:374] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:36.601366 16763 raft_consensus.cc:729] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4166358f16425cae4c206ab6d7698a, State: Initialized, Role: FOLLOWER
I20260809 01:57:36.601498 16763 consensus_queue.cc:260] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.601753 16763 ts_tablet_manager.cc:1428] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:57:36.602258 16201 catalog_manager.cc:4841] TS 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049): tablet 95656ffddbf04f88bc3e2d3a9cf3d260 (table test-table [id=fd8e5672a4724f01b8fffb519ac0a187]) successfully deleted
W20260809 01:57:36.617492 16738 tablet.cc:2369] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:57:36.656677 16580 tablet.cc:2369] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:57:36.694852 16429 tablet.cc:2369] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:36.967634 16784 raft_consensus.cc:482] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:36.967779 16784 raft_consensus.cc:504] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.968248 16784 leader_election.cc:288] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055), 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049)
I20260809 01:57:36.968705 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd516d907c14e5f84f497a74572edc1" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" is_pre_election: true
I20260809 01:57:36.968711 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd516d907c14e5f84f497a74572edc1" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" is_pre_election: true
I20260809 01:57:36.968861 16529 raft_consensus.cc:2454] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 0.
I20260809 01:57:36.968884 16379 raft_consensus.cc:2454] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 0.
I20260809 01:57:36.969202 16608 leader_election.cc:302] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4166358f16425cae4c206ab6d7698a, 0dfdc9b92ceb4e09a06a9bcdadf06351; no voters:
I20260809 01:57:36.969417 16784 raft_consensus.cc:2781] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:36.969522 16784 raft_consensus.cc:482] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:36.969594 16784 raft_consensus.cc:3037] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.970650 16784 raft_consensus.cc:504] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.971050 16784 leader_election.cc:288] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 election: Requested vote from peers 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055), 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049)
I20260809 01:57:36.971378 16379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd516d907c14e5f84f497a74572edc1" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c702d3eff547dc8b44f2b18a4f42c3"
I20260809 01:57:36.971473 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd516d907c14e5f84f497a74572edc1" candidate_uuid: "0a4166358f16425cae4c206ab6d7698a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
I20260809 01:57:36.971525 16379 raft_consensus.cc:3037] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.971607 16529 raft_consensus.cc:3037] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:36.972402 16379 raft_consensus.cc:2454] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 1.
I20260809 01:57:36.972574 16529 raft_consensus.cc:2454] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a4166358f16425cae4c206ab6d7698a in term 1.
I20260809 01:57:36.972692 16607 leader_election.cc:302] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4166358f16425cae4c206ab6d7698a, 26c702d3eff547dc8b44f2b18a4f42c3; no voters:
I20260809 01:57:36.972869 16784 raft_consensus.cc:2781] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:36.972997 16784 raft_consensus.cc:686] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 1 LEADER]: Becoming Leader. State: Replica: 0a4166358f16425cae4c206ab6d7698a, State: Running, Role: LEADER
I20260809 01:57:36.973150 16784 consensus_queue.cc:237] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:36.974812 16214 catalog_manager.cc:5495] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a4166358f16425cae4c206ab6d7698a (127.14.175.195). New cstate: current_term: 1 leader_uuid: "0a4166358f16425cae4c206ab6d7698a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } health_report { overall_health: HEALTHY } } }
Aug 09 01:57:37 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240655, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:37.093573 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.084687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34630 (local address 127.14.175.254:37141)
0809 01:57:37.084955 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.084965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.085140 (+ 175us) server_negotiation.cc:407] Connection header received
0809 01:57:37.085253 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.085256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.085296 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.085387 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:37.086125 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.086669 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.087649 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.087871 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.087952 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.090232 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:37.090235 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:37.090237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:37.090255 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:37.091754 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.092252 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.092259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.092261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.092347 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.092622 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.092627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.092629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.092847 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:37.092948 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.093267 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.093412 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":185,"thread_start_us":140,"threads_started":1}
I20260809 01:57:37.093573 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.084644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37141 (local address 127.0.0.1:34630)
0809 01:57:37.085044 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.085061 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.085175 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.085427 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.085429 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.085914 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:37.086019 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.086025 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.086888 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.086890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.087540 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.087550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.087974 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.087976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.088046 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.088637 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:37.088649 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:37.090089 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:37.091856 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:37.091868 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:37.091874 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:37.092131 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:37.092445 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:37.092448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:37.092450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:37.092534 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:37.092948 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:37.092955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:37.093066 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.093187 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.093354 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":86,"threads_started":1}
I20260809 01:57:37.097514 16214 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:34630:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 01:57:37.098181 16214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:37.102945 16359 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0d8a122f2f4493acd854fa40aed4da (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=279ea8376e2b438eb6afd48acfc7ebfe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:37.103132 16506 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0d8a122f2f4493acd854fa40aed4da (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=279ea8376e2b438eb6afd48acfc7ebfe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:37.103204 16656 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0d8a122f2f4493acd854fa40aed4da (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=279ea8376e2b438eb6afd48acfc7ebfe]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:37.103420 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0d8a122f2f4493acd854fa40aed4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:37.103524 16506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0d8a122f2f4493acd854fa40aed4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:37.103547 16656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0d8a122f2f4493acd854fa40aed4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:37.106631 16801 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: Bootstrap starting.
I20260809 01:57:37.106698 16803 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: Bootstrap starting.
I20260809 01:57:37.106810 16802 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: Bootstrap starting.
I20260809 01:57:37.107605 16801 tablet_bootstrap.cc:654] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:37.107605 16803 tablet_bootstrap.cc:654] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:37.107756 16802 tablet_bootstrap.cc:654] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:37.108896 16801 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: No bootstrap required, opened a new log
I20260809 01:57:37.109011 16801 ts_tablet_manager.cc:1397] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:37.109256 16802 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: No bootstrap required, opened a new log
I20260809 01:57:37.109361 16802 ts_tablet_manager.cc:1397] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 01:57:37.109484 16801 raft_consensus.cc:348] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.109632 16801 raft_consensus.cc:374] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:37.109676 16801 raft_consensus.cc:729] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfdc9b92ceb4e09a06a9bcdadf06351, State: Initialized, Role: FOLLOWER
I20260809 01:57:37.109808 16801 consensus_queue.cc:260] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.109777 16802 raft_consensus.cc:348] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.109894 16802 raft_consensus.cc:374] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:37.109956 16802 raft_consensus.cc:729] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4166358f16425cae4c206ab6d7698a, State: Initialized, Role: FOLLOWER
I20260809 01:57:37.110076 16802 consensus_queue.cc:260] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.110344 16802 ts_tablet_manager.cc:1428] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:57:37.110299 16784 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.110455 16784 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.111266 16803 tablet_bootstrap.cc:492] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: No bootstrap required, opened a new log
I20260809 01:57:37.111377 16803 ts_tablet_manager.cc:1397] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:57:37.111846 16803 raft_consensus.cc:348] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.111974 16803 raft_consensus.cc:374] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:37.112018 16803 raft_consensus.cc:729] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c702d3eff547dc8b44f2b18a4f42c3, State: Initialized, Role: FOLLOWER
I20260809 01:57:37.112144 16803 consensus_queue.cc:260] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.112519 16803 ts_tablet_manager.cc:1428] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:37.112522 16808 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.110180 16801 ts_tablet_manager.cc:1428] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:37.112726 16808 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.110282 16807 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.112931 16807 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.373073 16808 raft_consensus.cc:482] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:37.373219 16808 raft_consensus.cc:504] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.374285 16808 leader_election.cc:288] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049), 0a4166358f16425cae4c206ab6d7698a (127.14.175.195:39025)
I20260809 01:57:37.379202 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.374703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:51371 (local address 127.14.175.195:39025)
0809 01:57:37.375108 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.375113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.375615 (+ 502us) server_negotiation.cc:407] Connection header received
0809 01:57:37.375662 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.375664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.375704 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.375774 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:37.376048 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.376768 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.378172 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.378579 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.378712 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.378765 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.378947 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.379065 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":95,"threads_started":1}
I20260809 01:57:37.379249 16813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.374544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:39025 (local address 127.14.175.193:51371)
0809 01:57:37.375203 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.375216 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.375303 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.375810 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.375812 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.375834 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:37.375925 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.375930 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.376917 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.376921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.378061 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.378068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.378712 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.378716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.378814 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.378843 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.378929 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.379054 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":316,"thread_start_us":122,"threads_started":1}
I20260809 01:57:37.379321 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.374659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:34543 (local address 127.14.175.194:43049)
0809 01:57:37.374920 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.374936 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.375118 (+ 182us) server_negotiation.cc:407] Connection header received
0809 01:57:37.375354 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.375358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.375410 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.375522 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:37.375779 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.376416 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.377945 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.378589 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.378701 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.378752 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.379111 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.379189 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":66,"threads_started":1}
I20260809 01:57:37.379747 16809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.374544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:43049 (local address 127.14.175.193:34543)
0809 01:57:37.375021 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.375038 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.375203 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.375536 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.375538 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.375554 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:37.375655 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.375659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.376527 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.376531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.377819 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.377831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.378831 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.378835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.378945 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.378993 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.379502 (+ 509us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.379603 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":21,"thread_start_us":106,"threads_started":1}
I20260809 01:57:37.380074 16687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0d8a122f2f4493acd854fa40aed4da" candidate_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4166358f16425cae4c206ab6d7698a" is_pre_election: true
I20260809 01:57:37.380219 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0d8a122f2f4493acd854fa40aed4da" candidate_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" is_pre_election: true
I20260809 01:57:37.380352 16529 raft_consensus.cc:2454] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c702d3eff547dc8b44f2b18a4f42c3 in term 0.
I20260809 01:57:37.380328 16687 raft_consensus.cc:2454] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c702d3eff547dc8b44f2b18a4f42c3 in term 0.
I20260809 01:57:37.380693 16310 leader_election.cc:302] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfdc9b92ceb4e09a06a9bcdadf06351, 26c702d3eff547dc8b44f2b18a4f42c3; no voters:
I20260809 01:57:37.380955 16808 raft_consensus.cc:2781] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:37.381043 16808 raft_consensus.cc:482] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:37.381093 16808 raft_consensus.cc:3037] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:37.382113 16808 raft_consensus.cc:504] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.382429 16808 leader_election.cc:288] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049), 0a4166358f16425cae4c206ab6d7698a (127.14.175.195:39025)
I20260809 01:57:37.382684 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0d8a122f2f4493acd854fa40aed4da" candidate_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351"
I20260809 01:57:37.382797 16529 raft_consensus.cc:3037] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:37.382784 16687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0d8a122f2f4493acd854fa40aed4da" candidate_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a4166358f16425cae4c206ab6d7698a"
I20260809 01:57:37.382893 16687 raft_consensus.cc:3037] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:37.383852 16687 raft_consensus.cc:2454] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c702d3eff547dc8b44f2b18a4f42c3 in term 1.
I20260809 01:57:37.384027 16529 raft_consensus.cc:2454] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c702d3eff547dc8b44f2b18a4f42c3 in term 1.
I20260809 01:57:37.384217 16309 leader_election.cc:302] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a4166358f16425cae4c206ab6d7698a, 26c702d3eff547dc8b44f2b18a4f42c3; no voters:
I20260809 01:57:37.384408 16808 raft_consensus.cc:2781] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:37.384639 16808 raft_consensus.cc:686] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 LEADER]: Becoming Leader. State: Replica: 26c702d3eff547dc8b44f2b18a4f42c3, State: Running, Role: LEADER
I20260809 01:57:37.384899 16808 consensus_queue.cc:237] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } }
I20260809 01:57:37.386267 16814 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: TxnStatusTablet state changed. Reason: New leader 26c702d3eff547dc8b44f2b18a4f42c3. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.386407 16814 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:37.386727 16816 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 01:57:37.386920 16816 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 01:57:37.387811 16214 catalog_manager.cc:5495] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193). New cstate: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } health_report { overall_health: UNKNOWN } } }
I20260809 01:57:37.402722 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.399025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:33055 (local address 127.0.0.1:47418)
0809 01:57:37.399157 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.399177 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.399294 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.399616 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.399619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.399626 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:37.399736 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.399741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.400568 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.400571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.401166 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.401174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.401670 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.401674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.401768 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.401810 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.402431 (+ 621us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.402448 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.402518 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.402603 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 01:57:37.403240 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.399079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47418 (local address 127.14.175.193:33055)
0809 01:57:37.399336 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.399345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.399363 (+ 18us) server_negotiation.cc:407] Connection header received
0809 01:57:37.399427 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.399430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.399487 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.399603 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:37.399868 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.400453 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.401295 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.401558 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.401671 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.401954 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.402332 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.402456 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.402526 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.402579 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":96,"threads_started":1}
I20260809 01:57:37.406246 16529 raft_consensus.cc:1261] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Refusing update from remote peer 26c702d3eff547dc8b44f2b18a4f42c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:37.406281 16687 raft_consensus.cc:1261] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Refusing update from remote peer 26c702d3eff547dc8b44f2b18a4f42c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:37.406723 16808 consensus_queue.cc:1035] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:37.406883 16814 consensus_queue.cc:1035] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:37.408954 16784 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: TxnStatusTablet state changed. Reason: New leader 26c702d3eff547dc8b44f2b18a4f42c3. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.409081 16784 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.409531 16807 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: TxnStatusTablet state changed. Reason: New leader 26c702d3eff547dc8b44f2b18a4f42c3. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.409644 16807 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.412205 16814 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.412318 16814 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:37.412596 16807 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.412688 16821 mvcc.cc:205] Tried to move back new op lower bound from 7316441732730548224 to 7316441732650741760. Current Snapshot: MvccSnapshot[applied={T|T < 7316441732730548224}]
I20260809 01:57:37.412698 16807 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0dfdc9b92ceb4e09a06a9bcdadf06351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.417714 16814 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.417857 16814 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 26c702d3eff547dc8b44f2b18a4f42c3: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:37.420447 16784 tablet_replica.cc:439] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 } } peers { permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 } } peers { permanent_uuid: "0a4166358f16425cae4c206ab6d7698a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 39025 } } }
I20260809 01:57:37.420568 16784 tablet_replica.cc:442] T 6e0d8a122f2f4493acd854fa40aed4da P 0a4166358f16425cae4c206ab6d7698a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:37.424472 16784 consensus_queue.cc:1035] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfdc9b92ceb4e09a06a9bcdadf06351" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 43049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:37.429018 16784 consensus_queue.cc:1035] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c702d3eff547dc8b44f2b18a4f42c3" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:37.430928 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.425622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:38893 (local address 127.14.175.193:33055)
0809 01:57:37.425739 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.425744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.426065 (+ 321us) server_negotiation.cc:407] Connection header received
0809 01:57:37.426285 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.426290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.426354 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.426403 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:37.427092 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.427795 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.429301 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.429719 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.429864 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.430267 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.430358 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.430408 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.430736 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.430791 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 01:57:37.430948 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.425264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:33055 (local address 127.14.175.195:38893)
0809 01:57:37.425978 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.425995 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.426151 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.426814 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.426818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.426828 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:37.426941 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.426948 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.427949 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.427954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.428896 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.428905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.429948 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.429955 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.430051 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.430101 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.430589 (+ 488us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.430596 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.430699 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.430781 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":101,"threads_started":1}
I20260809 01:57:37.457671 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.453721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:51727 (local address 127.14.175.195:39025)
0809 01:57:37.453852 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.453856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.453869 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:57:37.453910 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.453913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.453959 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.454046 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:37.454267 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.455113 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.456387 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.456777 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.456894 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.457243 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.457325 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.457398 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.457484 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.457544 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 01:57:37.457701 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.453350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:39025 (local address 127.14.175.193:51727)
0809 01:57:37.453657 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:37.453673 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:37.453772 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:37.454050 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:37.454052 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:37.454057 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:37.454157 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.454160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.455247 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.455251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.456264 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:37.456283 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.456932 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.456936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:37.457062 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.457111 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:37.457413 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:37.457419 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:57:37.457472 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 01:57:37.457531 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":105,"threads_started":1}
I20260809 01:57:37.481451 16213 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:37.481618 16213 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:37.483611 16213 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7b995d200ac49399428a6020f7f5998: Sending DeleteTablet for 3 replicas of tablet efd516d907c14e5f84f497a74572edc1
I20260809 01:57:37.484186 16506 tablet_service.cc:1514] Processing DeleteTablet for tablet efd516d907c14e5f84f497a74572edc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:37 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:37728
I20260809 01:57:37.484186 16656 tablet_service.cc:1514] Processing DeleteTablet for tablet efd516d907c14e5f84f497a74572edc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:37 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:39764
I20260809 01:57:37.484208 16359 tablet_service.cc:1514] Processing DeleteTablet for tablet efd516d907c14e5f84f497a74572edc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:37 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47414
I20260809 01:57:37.484608 16840 tablet_replica.cc:330] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: stopping tablet replica
I20260809 01:57:37.484771 16840 raft_consensus.cc:2229] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:37.484805 16839 tablet_replica.cc:330] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: stopping tablet replica
I20260809 01:57:37.484927 16840 raft_consensus.cc:2258] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:37.484925 16839 raft_consensus.cc:2229] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:37.485100 16839 raft_consensus.cc:2258] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:37.485657 16840 ts_tablet_manager.cc:1905] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:37.485657 16839 ts_tablet_manager.cc:1905] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:37.488689 16839 ts_tablet_manager.cc:1918] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:37.488689 16840 ts_tablet_manager.cc:1918] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:37.488776 16840 log.cc:1196] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/efd516d907c14e5f84f497a74572edc1
I20260809 01:57:37.488787 16839 log.cc:1196] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/efd516d907c14e5f84f497a74572edc1
I20260809 01:57:37.489077 16839 ts_tablet_manager.cc:1939] T efd516d907c14e5f84f497a74572edc1 P 0a4166358f16425cae4c206ab6d7698a: Deleting consensus metadata
I20260809 01:57:37.489089 16840 ts_tablet_manager.cc:1939] T efd516d907c14e5f84f497a74572edc1 P 0dfdc9b92ceb4e09a06a9bcdadf06351: Deleting consensus metadata
I20260809 01:57:37.489729 16841 tablet_replica.cc:330] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: stopping tablet replica
I20260809 01:57:37.489846 16200 catalog_manager.cc:4841] TS 0a4166358f16425cae4c206ab6d7698a (127.14.175.195:39025): tablet efd516d907c14e5f84f497a74572edc1 (table test-table [id=4ff673cadf24482284b58fab12a5a79f]) successfully deleted
I20260809 01:57:37.489885 16841 raft_consensus.cc:2229] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:37.490003 16841 raft_consensus.cc:2258] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:37.490005 16201 catalog_manager.cc:4841] TS 0dfdc9b92ceb4e09a06a9bcdadf06351 (127.14.175.194:43049): tablet efd516d907c14e5f84f497a74572edc1 (table test-table [id=4ff673cadf24482284b58fab12a5a79f]) successfully deleted
I20260809 01:57:37.490707 16841 ts_tablet_manager.cc:1905] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:37.493443 16841 ts_tablet_manager.cc:1918] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:37.493548 16841 log.cc:1196] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/efd516d907c14e5f84f497a74572edc1
I20260809 01:57:37.493861 16841 ts_tablet_manager.cc:1939] T efd516d907c14e5f84f497a74572edc1 P 26c702d3eff547dc8b44f2b18a4f42c3: Deleting consensus metadata
I20260809 01:57:37.494630 16200 catalog_manager.cc:4841] TS 26c702d3eff547dc8b44f2b18a4f42c3 (127.14.175.193:33055): tablet efd516d907c14e5f84f497a74572edc1 (table test-table [id=4ff673cadf24482284b58fab12a5a79f]) successfully deleted
Aug 09 01:57:37 dist-test-slave-2w3w krb5kdc[16168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240656, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:37.500571 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.486042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47420 (local address 127.14.175.193:33055)
0809 01:57:37.486146 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.486151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.489831 (+ 3680us) server_negotiation.cc:407] Connection header received
0809 01:57:37.490031 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.490035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.490084 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.490142 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:37.491141 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.491921 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.493111 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.493468 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.493580 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.496603 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:37.496611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:37.496627 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:37.496652 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:37.498656 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.499211 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.499217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.499219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.499314 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.499586 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.499589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.499590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.499917 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:37.500128 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.500275 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.500403 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 01:57:37.501107 16421 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420
I20260809 01:57:37.511107 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:37.502937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34646 (local address 127.14.175.254:37141)
0809 01:57:37.503088 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:37.503093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:37.503201 (+ 108us) server_negotiation.cc:407] Connection header received
0809 01:57:37.503281 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:37.503284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:37.503331 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:37.503418 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:37.504274 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.505078 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.505963 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:37.506310 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:37.506423 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:37.507829 (+ 1406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:37.507833 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:37.507836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:37.507864 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:37.509399 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.509892 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.509895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.509896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.509970 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:37.510260 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:37.510262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:37.510263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:37.510428 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:37.510523 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:37.510783 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 01:57:37.510902 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 01:57:37.511513 16213 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34646
I20260809 01:57:37.512679 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16291
I20260809 01:57:37.522238 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16437
I20260809 01:57:37.529500 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16588
I20260809 01:57:37.537663 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16181
2026-08-09T01:57:37Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3281 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:37 dist-test-slave-2w3w krb5kdc[16848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:37 dist-test-slave-2w3w krb5kdc[16848](info): set up 2 sockets
Aug 09 01:57:37 dist-test-slave-2w3w krb5kdc[16848](info): commencing operation
krb5kdc: starting...
W20260809 01:57:38.613116 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:38 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:38.740118 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34777
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:34777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:38.849699 16863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:38.850011 16863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:38.850106 16863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:38.854046 16863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:38.854126 16863 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 01:57:38.854159 16863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:38.854199 16863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:38.854238 16863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:38.854272 16863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:38.859359 16863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:34777
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:38.860308 16863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:38.861344 16863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:38.869545 16871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:38.869606 16869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:38.869663 16863 server_base.cc:1034] running on GCE node
W20260809 01:57:38.869545 16868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:38.870360 16863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:38.871428 16863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:38.872618 16863 hybrid_clock.cc:648] HybridClock initialized: now 1786240658872590 us; error 41 us; skew 500 ppm
Aug 09 01:57:38 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240658, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:38.875329 16863 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:38.876125 16863 webserver.cc:460] Webserver started at http://127.14.175.254:45415/ using document root <none> and password file <none>
I20260809 01:57:38.876650 16863 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:38.876784 16863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:38.877017 16863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:38.878925 16863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "9404110b87134d9e8d118cb790985f2b"
format_stamp: "Formatted at 2026-08-09 01:57:38 on dist-test-slave-2w3w"
server_key: "5dfb66346257263bd3caeef29cf7c79b"
server_key_iv: "517aa6e803db8e3a057059a33d813999"
server_key_version: "encryptionkey@0"
I20260809 01:57:38.879607 16863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "9404110b87134d9e8d118cb790985f2b"
format_stamp: "Formatted at 2026-08-09 01:57:38 on dist-test-slave-2w3w"
server_key: "5dfb66346257263bd3caeef29cf7c79b"
server_key_iv: "517aa6e803db8e3a057059a33d813999"
server_key_version: "encryptionkey@0"
I20260809 01:57:38.883154 16863 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:38.885376 16878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:38.886516 16863 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:38.886650 16863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "9404110b87134d9e8d118cb790985f2b"
format_stamp: "Formatted at 2026-08-09 01:57:38 on dist-test-slave-2w3w"
server_key: "5dfb66346257263bd3caeef29cf7c79b"
server_key_iv: "517aa6e803db8e3a057059a33d813999"
server_key_version: "encryptionkey@0"
I20260809 01:57:38.886765 16863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:38.904712 16863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:38.907341 16863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:38.907537 16863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:38.915391 16863 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:34777
I20260809 01:57:38.915421 16943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:34777 every 8 connection(s)
I20260809 01:57:38.916280 16863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:38.918920 16944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:38.924193 16944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Bootstrap starting.
I20260809 01:57:38.926354 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16863
I20260809 01:57:38.926469 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:38.926687 16944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:38.926785 15039 external_mini_cluster.cc:1428] Setting key 77d14c1e487d0c11f9e0c4d8b6ddedb1
I20260809 01:57:38.927557 16944 log.cc:824] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:38.929452 16944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: No bootstrap required, opened a new log
I20260809 01:57:38.933874 16944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } }
I20260809 01:57:38.934175 16944 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:38.934242 16944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9404110b87134d9e8d118cb790985f2b, State: Initialized, Role: FOLLOWER
I20260809 01:57:38.934775 16944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } }
I20260809 01:57:38.934939 16944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:38.935047 16944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:38.935173 16944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 0 FOLLOWER]: Advancing to term 1
Aug 09 01:57:38 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:38.936120 16944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } }
I20260809 01:57:38.936441 16944 leader_election.cc:302] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9404110b87134d9e8d118cb790985f2b; no voters:
I20260809 01:57:38.936769 16944 leader_election.cc:288] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:38.936993 16949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:38.937280 16949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [term 1 LEADER]: Becoming Leader. State: Replica: 9404110b87134d9e8d118cb790985f2b, State: Running, Role: LEADER
I20260809 01:57:38.937584 16949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } }
I20260809 01:57:38.938061 16944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:38.939236 16951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9404110b87134d9e8d118cb790985f2b. Latest consensus state: current_term: 1 leader_uuid: "9404110b87134d9e8d118cb790985f2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } } }
I20260809 01:57:38.939365 16951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:38.939677 16950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9404110b87134d9e8d118cb790985f2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9404110b87134d9e8d118cb790985f2b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34777 } } }
I20260809 01:57:38.939807 16950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:38.939775 16959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:38.943223 16959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:38.943737 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:38.927943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.14.175.254:34777)
0809 01:57:38.928342 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:38.928358 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:38.928393 (+ 35us) server_negotiation.cc:407] Connection header received
0809 01:57:38.928998 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:38.929022 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:38.929319 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:38.929657 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:38.930465 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:38.931582 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:38.932759 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:38.933233 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:38.933350 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:38.936232 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:38.936239 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:38.936256 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:38.936293 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:38.939968 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:38.940543 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:38.940549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:38.940554 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:38.940695 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:38.941060 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:38.941063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:38.941065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:38.941554 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:38.941753 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:38.942500 (+ 747us) server_negotiation.cc:299] Negotiation successful
0809 01:57:38.942789 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":129,"threads_started":1}
I20260809 01:57:38.948825 16959 catalog_manager.cc:1347] Generated new cluster ID: 3130065b8ac24ab9ab6189a2cd8eaea2
I20260809 01:57:38.948890 16959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:38.969463 16959 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:38.970707 16959 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:38.982369 16959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Generated new TSK 0
I20260809 01:57:38.983428 16959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:39.014174 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34777
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:39.125610 16971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:39.125878 16971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:39.125958 16971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:39.129937 16971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:39.130021 16971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:39.130095 16971 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 01:57:39.130136 16971 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:39.130198 16971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:39.135425 16971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:39.136440 16971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:39.137477 16971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:39.146813 16976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:39.146842 16979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:39.147009 16971 server_base.cc:1034] running on GCE node
W20260809 01:57:39.146817 16977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:39.147432 16971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:39.148084 16971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:39.149246 16971 hybrid_clock.cc:648] HybridClock initialized: now 1786240659149217 us; error 40 us; skew 500 ppm
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:39.152443 16971 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:39.153239 16971 webserver.cc:460] Webserver started at http://127.14.175.193:42593/ using document root <none> and password file <none>
I20260809 01:57:39.153769 16971 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:39.153860 16971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:39.154083 16971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:39.156061 16971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "8edd82dc356c4316a14940012ea40940"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "845d32d2ddab304794bc1e51c9580135"
server_key_iv: "66564abe2c1118e7be627a1a2580fddb"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.156629 16971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "8edd82dc356c4316a14940012ea40940"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "845d32d2ddab304794bc1e51c9580135"
server_key_iv: "66564abe2c1118e7be627a1a2580fddb"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.160187 16971 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:57:39.162411 16987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.163594 16971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:39.163722 16971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "8edd82dc356c4316a14940012ea40940"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "845d32d2ddab304794bc1e51c9580135"
server_key_iv: "66564abe2c1118e7be627a1a2580fddb"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.163862 16971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:39.175171 16971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:39.177685 16971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:39.177872 16971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:39.179203 16971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:39.179272 16971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.179348 16971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:39.179390 16971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:39.189850 16971 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:46721
I20260809 01:57:39.190034 17107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:46721 every 8 connection(s)
I20260809 01:57:39.190893 16971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:39.193910 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.179943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:45267 (local address 127.14.175.254:34777)
0809 01:57:39.180108 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.180113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.181360 (+ 1247us) server_negotiation.cc:407] Connection header received
0809 01:57:39.182578 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.182581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.182639 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.182725 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.184334 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.185233 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.187081 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.187314 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.187397 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.190473 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.190478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.190481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.190513 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.192177 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.192632 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.192634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.192636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.192709 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.192995 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.192997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.192999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.193160 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.193234 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.193659 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.193766 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 01:57:39.194612 16997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.180754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.193:45267)
0809 01:57:39.181189 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.181249 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.182343 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.182922 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.182930 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.183485 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.184169 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.184190 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.185389 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.185394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.186918 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.186932 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.187468 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.187472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.187689 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.188394 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.188418 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.190284 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.192277 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.192281 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.192290 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.192545 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.192787 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.192789 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.192791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.192915 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.193247 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.193251 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.193446 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.193602 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.193820 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":129,"threads_started":1}
I20260809 01:57:39.195822 17108 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34777
I20260809 01:57:39.195955 17108 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:39.196463 17108 heartbeater.cc:511] Master 127.14.175.254:34777 requested a full tablet report, sending...
I20260809 01:57:39.198058 16895 ts_manager.cc:194] Registered new tserver with Master: 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721)
I20260809 01:57:39.199355 16895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:45267
I20260809 01:57:39.200628 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 16971
I20260809 01:57:39.200760 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:39.201082 15039 external_mini_cluster.cc:1428] Setting key ae7718f8f7811a6dbe96347be3722b1f
I20260809 01:57:39.205430 17114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.197989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.193:48955)
0809 01:57:39.198252 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.198267 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.198379 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.198612 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.198615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.198837 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.198934 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.198940 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.199772 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.199775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.200492 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.200514 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.201195 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.201200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.201292 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.201786 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.201798 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.202103 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.203857 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.203863 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.203868 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.204132 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.204415 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.204421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.204426 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.204536 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.205039 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.205041 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.205115 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.205198 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.205296 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":90,"threads_started":1}
I20260809 01:57:39.205627 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.198088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:48955 (local address 127.14.175.254:34777)
0809 01:57:39.198216 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.198220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.198342 (+ 122us) server_negotiation.cc:407] Connection header received
0809 01:57:39.198465 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.198468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.198509 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.198596 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.199076 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.199647 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.200646 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.201006 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.201123 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.202238 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.202242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.202246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.202282 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.203741 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.204236 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.204239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.204240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.204325 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.204674 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.204679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.204681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.204929 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.205044 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.205281 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.205422 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:39.229548 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34777
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:39.337736 17117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:39.338086 17117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:39.338178 17117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:39.342422 17117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:39.342499 17117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:39.342574 17117 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 01:57:39.342619 17117 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:39.342680 17117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:39.347803 17117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:39.348791 17117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:39.349766 17117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:39.359165 17124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:39.359236 17126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:39.359231 17122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:39.359544 17117 server_base.cc:1034] running on GCE node
I20260809 01:57:39.359970 17117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:39.360590 17117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:39.361783 17117 hybrid_clock.cc:648] HybridClock initialized: now 1786240659361769 us; error 27 us; skew 500 ppm
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:39.364683 17117 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:39.365526 17117 webserver.cc:460] Webserver started at http://127.14.175.194:45013/ using document root <none> and password file <none>
I20260809 01:57:39.366070 17117 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:39.366163 17117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:39.366442 17117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:39.368597 17117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "4e33c7a928ef248218a6843e09d9cc88"
server_key_iv: "cb752b549bc694b3c0c867fda2c7f8d1"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.369145 17117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "4e33c7a928ef248218a6843e09d9cc88"
server_key_iv: "cb752b549bc694b3c0c867fda2c7f8d1"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.372766 17117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 01:57:39.374989 17133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.376142 17117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:57:39.376288 17117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "4e33c7a928ef248218a6843e09d9cc88"
server_key_iv: "cb752b549bc694b3c0c867fda2c7f8d1"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.376398 17117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:39.394543 17117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:39.397600 17117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:39.397818 17117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:39.399253 17117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:39.399326 17117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.399391 17117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:39.399443 17117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:39.410279 17117 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38861
I20260809 01:57:39.410311 17260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38861 every 8 connection(s)
I20260809 01:57:39.411453 17117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:39.413316 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.400014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:59329 (local address 127.14.175.254:34777)
0809 01:57:39.400178 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.400183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.401103 (+ 920us) server_negotiation.cc:407] Connection header received
0809 01:57:39.402298 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.402305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.402376 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.402489 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.403932 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.404798 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.406303 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.406710 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.406838 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.409564 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.409571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.409578 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.409622 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.411359 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.411940 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.411943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.411945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.412052 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.412421 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.412424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.412425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.412599 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.412682 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.413105 (+ 423us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.413201 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 01:57:39.414088 17143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.400445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.194:59329)
0809 01:57:39.400927 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.400976 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.402033 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.402689 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.402701 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.403179 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.403782 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.403798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.404920 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.404924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.406176 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.406185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.406892 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.406896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.407117 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.407675 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.407691 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.409393 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.411476 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.411481 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.411490 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.411807 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.412168 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.412171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.412172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.412334 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.412694 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.412698 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.412898 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.413056 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.413281 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":176,"threads_started":1}
I20260809 01:57:39.415371 17261 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34777
I20260809 01:57:39.415539 17261 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:39.415558 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 17117
I20260809 01:57:39.415689 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:39.416011 15039 external_mini_cluster.cc:1428] Setting key 6419ed8302c50ea8328cae1423f3e6a2
I20260809 01:57:39.416136 17261 heartbeater.cc:511] Master 127.14.175.254:34777 requested a full tablet report, sending...
I20260809 01:57:39.417199 16895 ts_manager.cc:194] Registered new tserver with Master: 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:39.417902 16895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:59329
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:39.426692 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.417797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53661 (local address 127.14.175.254:34777)
0809 01:57:39.417896 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.417900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.419962 (+ 2062us) server_negotiation.cc:407] Connection header received
0809 01:57:39.420082 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.420086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.420142 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.420232 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.420628 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.421247 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.422089 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.422310 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.422415 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.423513 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.423519 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.423528 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.423550 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.424957 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.425383 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.425388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.425390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.425470 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.425775 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.425780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.425782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.426044 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.426151 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.426422 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.426538 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 01:57:39.426699 17267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.417725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.194:53661)
0809 01:57:39.419861 (+ 2136us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.419876 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.419975 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.420257 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.420259 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.420421 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.420510 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.420515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.421382 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.421385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.421963 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.421971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.422429 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.422433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.422535 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.423043 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.423054 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.423364 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.425073 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.425079 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.425081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.425282 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.425567 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.425571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.425573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.425683 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.426142 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.426145 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.426259 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.426368 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.426520 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2054,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:39.445783 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34777
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:39.556335 17270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:39.556566 17270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:39.556612 17270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:39.560649 17270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:39.560700 17270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:39.560774 17270 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 01:57:39.560813 17270 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:57:39.560896 17270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:39.566006 17270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:39.567073 17270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:39.568053 17270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:39.577955 17275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:39.577955 17276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:39.578112 17270 server_base.cc:1034] running on GCE node
W20260809 01:57:39.578337 17278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:39.578739 17270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:39.579382 17270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:39.580566 17270 hybrid_clock.cc:648] HybridClock initialized: now 1786240659580551 us; error 39 us; skew 500 ppm
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:39.583411 17270 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:39.584219 17270 webserver.cc:460] Webserver started at http://127.14.175.195:45987/ using document root <none> and password file <none>
I20260809 01:57:39.584745 17270 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:39.584806 17270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:39.585040 17270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:39.587057 17270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "7e79a497071b4cd7aca3b34258d78b71"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "256e157afad8386ec7002999877c2fcd"
server_key_iv: "be65475fe7b6bbe9bfeb920958a9c30c"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.587626 17270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "7e79a497071b4cd7aca3b34258d78b71"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "256e157afad8386ec7002999877c2fcd"
server_key_iv: "be65475fe7b6bbe9bfeb920958a9c30c"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.591382 17270 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 01:57:39.593550 17286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.594688 17270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:39.594830 17270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "7e79a497071b4cd7aca3b34258d78b71"
format_stamp: "Formatted at 2026-08-09 01:57:39 on dist-test-slave-2w3w"
server_key: "256e157afad8386ec7002999877c2fcd"
server_key_iv: "be65475fe7b6bbe9bfeb920958a9c30c"
server_key_version: "encryptionkey@0"
I20260809 01:57:39.594930 17270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:39.609217 17270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:39.612512 17270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:39.612712 17270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:39.614058 17270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:39.614105 17270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:39.614143 17270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:39.614199 17270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:39.625468 17270 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:45645
I20260809 01:57:39.625555 17407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:45645 every 8 connection(s)
I20260809 01:57:39.626554 17270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:39.628901 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.614929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48143 (local address 127.14.175.254:34777)
0809 01:57:39.615091 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.615096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.616169 (+ 1073us) server_negotiation.cc:407] Connection header received
0809 01:57:39.617067 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.617070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.617130 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.617244 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.619008 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.619937 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.621893 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.622205 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.622309 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.625322 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.625326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.625328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.625363 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.627017 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.627607 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.627610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.627611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.627694 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.628020 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.628023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.628024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.628197 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.628273 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.628683 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.628785 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 01:57:39.629679 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.615448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.195:48143)
0809 01:57:39.616016 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.616056 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.616860 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.617496 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.617518 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.618036 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.618704 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.618731 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.620125 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.620131 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.621751 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.621765 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.622354 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.622359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.622567 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.623210 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.623232 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.625123 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.627152 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.627157 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.627169 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.627494 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.627780 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.627782 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.627783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.627935 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.628281 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.628285 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.628487 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.628633 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.628885 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":183,"threads_started":1}
I20260809 01:57:39.630805 17408 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34777
I20260809 01:57:39.630959 17408 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:39.631430 17408 heartbeater.cc:511] Master 127.14.175.254:34777 requested a full tablet report, sending...
I20260809 01:57:39.631641 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 17270
I20260809 01:57:39.631781 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:39.632109 15039 external_mini_cluster.cc:1428] Setting key 0f443f50d0f21244ed2a03b3ad5605e7
I20260809 01:57:39.632571 16896 ts_manager.cc:194] Registered new tserver with Master: 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645)
I20260809 01:57:39.633354 16896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:48143
I20260809 01:57:39.634191 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:57:39.641129 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.633245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:36025 (local address 127.14.175.254:34777)
0809 01:57:39.633343 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.633347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.633585 (+ 238us) server_negotiation.cc:407] Connection header received
0809 01:57:39.633697 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.633700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.633746 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.633836 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.634299 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.635084 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.636336 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.636587 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.636713 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.637840 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.637844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.637848 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.637878 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.639462 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.639921 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.639926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.639927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.640024 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.640269 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.640274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.640276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.640498 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.640580 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.640931 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.641023 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 01:57:39.641315 17416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.633185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.14.175.195:36025)
0809 01:57:39.633503 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.633515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.633623 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.633843 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.633846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.634046 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.634167 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.634176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.635230 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.635236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.636203 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.636218 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.636724 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.636729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.636840 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.637339 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.637350 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.637706 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.639611 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.639615 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.639619 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.639808 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.640120 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.640122 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.640123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.640185 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.640608 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.640611 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.640714 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.640841 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.641013 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":87,"threads_started":1}
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:39.660657 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.653388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58074 (local address 127.14.175.254:34777)
0809 01:57:39.653512 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.653515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.653527 (+ 12us) server_negotiation.cc:407] Connection header received
0809 01:57:39.653559 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.653561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.653594 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.653659 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.654288 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.654784 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.655650 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.655852 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.655929 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.658091 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.658094 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.658096 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.658116 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.659336 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.659704 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.659706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.659707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.659773 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.660031 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.660033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.660034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.660176 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.660275 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.660477 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.660557 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:57:39.663429 16895 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:39.666299 16895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:39.680503 17429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.674252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46721 (local address 127.0.0.1:43582)
0809 01:57:39.674702 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.674753 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.674909 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.676094 (+ 1185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.676101 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.676124 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:39.676277 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.676285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.677458 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.677464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.678808 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.678818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.679947 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.679951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.680065 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.680106 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.680212 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.680347 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":46,"spinlock_wait_cycles":16256,"thread_start_us":103,"threads_started":1}
I20260809 01:57:39.680680 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.674265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45645 (local address 127.0.0.1:55558)
0809 01:57:39.674716 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.674753 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.674909 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.676145 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.676148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.676178 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:39.676287 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.676294 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.677760 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.677763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.679195 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.679206 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.680234 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.680238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.680354 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.680377 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.680440 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.680522 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":220,"spinlock_wait_cycles":3456,"thread_start_us":85,"threads_started":1}
I20260809 01:57:39.680773 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.675422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55558 (local address 127.14.175.195:45645)
0809 01:57:39.675747 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.675755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.675775 (+ 20us) server_negotiation.cc:407] Connection header received
0809 01:57:39.675833 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.675836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.675969 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.676142 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:39.676434 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.677609 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.679323 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.680116 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.680338 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.680468 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.680518 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.680626 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":132,"threads_started":1}
I20260809 01:57:39.681120 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.674406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.14.175.193:46721)
0809 01:57:39.675238 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.675258 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.675282 (+ 24us) server_negotiation.cc:407] Connection header received
0809 01:57:39.675769 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.675774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.675927 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.676047 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:39.676415 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.677354 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.678931 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.679821 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.679980 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.680114 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.680860 (+ 746us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.680978 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":79,"threads_started":1}
I20260809 01:57:39.682309 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.675018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.0.0.1:48096)
0809 01:57:39.675309 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.675323 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.675409 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.676823 (+ 1414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.676826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.676845 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:39.676931 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.676937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.678249 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.678253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.679623 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.679632 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.681957 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.681961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.682051 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.682074 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.682124 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.682192 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":239,"thread_start_us":92,"threads_started":1}
I20260809 01:57:39.683051 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.675467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48096 (local address 127.14.175.194:38861)
0809 01:57:39.676397 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.676412 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.676433 (+ 21us) server_negotiation.cc:407] Connection header received
0809 01:57:39.676507 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.676512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.676673 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.676822 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:39.677055 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.678127 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.679761 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.681159 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.682612 (+ 1453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.682728 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.682790 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.682888 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":99,"threads_started":1}
I20260809 01:57:39.683761 17337 tablet_service.cc:1467] Processing CreateTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c (DEFAULT_TABLE table=test-table [id=6f2219ce8576467786292d7d8e74e775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:39.683769 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c (DEFAULT_TABLE table=test-table [id=6f2219ce8576467786292d7d8e74e775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:39.684765 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92c098c3e30e4c0ab27cfe26eed3145c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.684805 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92c098c3e30e4c0ab27cfe26eed3145c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.685626 17191 tablet_service.cc:1467] Processing CreateTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c (DEFAULT_TABLE table=test-table [id=6f2219ce8576467786292d7d8e74e775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:39.686620 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92c098c3e30e4c0ab27cfe26eed3145c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.692028 17434 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Bootstrap starting.
I20260809 01:57:39.692620 17435 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Bootstrap starting.
I20260809 01:57:39.694693 17435 tablet_bootstrap.cc:654] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.694693 17434 tablet_bootstrap.cc:654] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.694903 17436 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Bootstrap starting.
I20260809 01:57:39.695660 17434 log.cc:824] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:39.695660 17435 log.cc:824] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:39.697223 17436 tablet_bootstrap.cc:654] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.697715 17434 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: No bootstrap required, opened a new log
I20260809 01:57:39.697820 17435 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: No bootstrap required, opened a new log
I20260809 01:57:39.697854 17434 ts_tablet_manager.cc:1397] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260809 01:57:39.697999 17435 ts_tablet_manager.cc:1397] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:57:39.698050 17436 log.cc:824] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:39.700168 17436 tablet_bootstrap.cc:492] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: No bootstrap required, opened a new log
I20260809 01:57:39.700362 17436 ts_tablet_manager.cc:1397] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:57:39.701241 17434 raft_consensus.cc:348] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.701507 17434 raft_consensus.cc:374] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.701571 17434 raft_consensus.cc:729] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.702021 17434 consensus_queue.cc:260] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.701900 17435 raft_consensus.cc:348] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.702174 17435 raft_consensus.cc:374] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.702247 17435 raft_consensus.cc:729] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.702662 17435 consensus_queue.cc:260] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.703064 17434 ts_tablet_manager.cc:1428] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260809 01:57:39.703419 17408 heartbeater.cc:503] Master 127.14.175.254:34777 was elected leader, sending a full tablet report...
I20260809 01:57:39.703433 17108 heartbeater.cc:503] Master 127.14.175.254:34777 was elected leader, sending a full tablet report...
I20260809 01:57:39.703682 17435 ts_tablet_manager.cc:1428] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260809 01:57:39.705673 17436 raft_consensus.cc:348] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.705976 17436 raft_consensus.cc:374] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.706045 17436 raft_consensus.cc:729] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.706534 17436 consensus_queue.cc:260] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.707685 17261 heartbeater.cc:503] Master 127.14.175.254:34777 was elected leader, sending a full tablet report...
I20260809 01:57:39.708261 17436 ts_tablet_manager.cc:1428] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260809 01:57:39.715698 17441 raft_consensus.cc:482] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:39.715903 17441 raft_consensus.cc:504] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.717015 17441 leader_election.cc:288] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:39.721127 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.717742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:45675 (local address 127.14.175.194:38861)
0809 01:57:39.717865 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.717869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.718005 (+ 136us) server_negotiation.cc:407] Connection header received
0809 01:57:39.718105 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.718108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.718154 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.718241 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:39.718526 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.719087 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720146 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.720549 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720681 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.720736 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.720921 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.720999 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:57:39.721189 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.717343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:33999 (local address 127.14.175.195:45645)
0809 01:57:39.717485 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.717490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.717606 (+ 116us) server_negotiation.cc:407] Connection header received
0809 01:57:39.717770 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.717775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.717825 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.717906 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:39.718297 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.718907 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720147 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.720552 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720684 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.720736 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.720989 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.721079 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:57:39.721150 17444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.717620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.14.175.193:45675)
0809 01:57:39.717923 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.717936 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.718022 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.718278 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.718282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.718298 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:39.718419 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.718425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.719188 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.719191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.720018 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.720028 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.720690 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.720800 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.720818 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.720878 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.720964 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":36,"thread_start_us":68,"threads_started":1}
I20260809 01:57:39.721179 17443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.717199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45645 (local address 127.14.175.193:33999)
0809 01:57:39.717513 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.717535 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.717663 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.717953 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.717956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.717994 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:39.718179 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.718190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.719063 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.719066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.720020 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.720029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.720709 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.720712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.720832 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.720849 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.720949 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.721016 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":50,"spinlock_wait_cycles":19200,"thread_start_us":106,"threads_started":1}
I20260809 01:57:39.722031 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92c098c3e30e4c0ab27cfe26eed3145c" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" is_pre_election: true
I20260809 01:57:39.722323 17202 raft_consensus.cc:2454] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 0.
I20260809 01:57:39.722892 16990 leader_election.cc:302] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:39.722856 17359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92c098c3e30e4c0ab27cfe26eed3145c" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71" is_pre_election: true
I20260809 01:57:39.723178 17359 raft_consensus.cc:2454] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 0.
I20260809 01:57:39.723176 17441 raft_consensus.cc:2781] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:39.723268 17441 raft_consensus.cc:482] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:39.723311 17441 raft_consensus.cc:3037] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:39.724367 17441 raft_consensus.cc:504] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.724676 17441 leader_election.cc:288] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 election: Requested vote from peers 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:39.724992 17359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92c098c3e30e4c0ab27cfe26eed3145c" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71"
I20260809 01:57:39.725111 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92c098c3e30e4c0ab27cfe26eed3145c" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
I20260809 01:57:39.725144 17359 raft_consensus.cc:3037] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:39.725229 17202 raft_consensus.cc:3037] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:39.726171 17359 raft_consensus.cc:2454] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 1.
I20260809 01:57:39.726464 17202 raft_consensus.cc:2454] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 1.
I20260809 01:57:39.726549 16990 leader_election.cc:302] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e79a497071b4cd7aca3b34258d78b71, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:39.726723 17441 raft_consensus.cc:2781] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:39.727028 17441 raft_consensus.cc:686] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 1 LEADER]: Becoming Leader. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Running, Role: LEADER
I20260809 01:57:39.727360 17441 consensus_queue.cc:237] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } }
I20260809 01:57:39.730263 16896 catalog_manager.cc:5495] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8edd82dc356c4316a14940012ea40940 (127.14.175.193). New cstate: current_term: 1 leader_uuid: "8edd82dc356c4316a14940012ea40940" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } health_report { overall_health: UNKNOWN } } }
Aug 09 01:57:39 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240658, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:39.772941 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.764813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34777 (local address 127.0.0.1:58078)
0809 01:57:39.765127 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:39.765138 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:39.765271 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:39.765534 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:39.765537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:39.765971 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:39.766065 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.766071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.766831 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.766835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.767414 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:39.767422 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.767858 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.767862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:39.767942 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.768533 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:39.768545 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:39.769972 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:39.771542 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.771550 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.771555 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.771779 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.772023 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:39.772025 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:39.772026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:39.772105 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:39.772495 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:39.772499 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:39.772604 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 01:57:39.772695 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 01:57:39.772800 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":117,"threads_started":1}
I20260809 01:57:39.773154 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:39.764859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.14.175.254:34777)
0809 01:57:39.765015 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:39.765021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:39.765223 (+ 202us) server_negotiation.cc:407] Connection header received
0809 01:57:39.765383 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:39.765388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:39.765429 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:39.765516 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:39.766190 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.766713 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.767535 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:39.767745 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:39.767855 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:39.770107 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:39.770110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:39.770112 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:39.770133 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:39.771437 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.771866 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.771869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.771870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.771941 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:39.772190 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:39.772192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:39.772193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:39.772363 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:39.772484 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:39.772767 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 01:57:39.772925 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:57:39.776675 16896 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:58078:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 01:57:39.777457 16896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:39.782428 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 92b70bbf20c24f71b14b3d5a529db8a0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=794bec1fd7d54b7fb7e899547179e230]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:39.782707 17191 tablet_service.cc:1467] Processing CreateTablet for tablet 92b70bbf20c24f71b14b3d5a529db8a0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=794bec1fd7d54b7fb7e899547179e230]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:39.782734 17337 tablet_service.cc:1467] Processing CreateTablet for tablet 92b70bbf20c24f71b14b3d5a529db8a0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=794bec1fd7d54b7fb7e899547179e230]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:57:39.783265 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b70bbf20c24f71b14b3d5a529db8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.783267 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b70bbf20c24f71b14b3d5a529db8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.783408 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b70bbf20c24f71b14b3d5a529db8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:39.786118 17434 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: Bootstrap starting.
I20260809 01:57:39.786144 17435 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: Bootstrap starting.
I20260809 01:57:39.786201 17436 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Bootstrap starting.
I20260809 01:57:39.787097 17434 tablet_bootstrap.cc:654] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.787196 17435 tablet_bootstrap.cc:654] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.787196 17436 tablet_bootstrap.cc:654] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:39.788749 17436 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: No bootstrap required, opened a new log
I20260809 01:57:39.788820 17436 ts_tablet_manager.cc:1397] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 01:57:39.789098 17434 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: No bootstrap required, opened a new log
I20260809 01:57:39.789237 17434 ts_tablet_manager.cc:1397] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 01:57:39.789314 17436 raft_consensus.cc:348] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.789461 17436 raft_consensus.cc:374] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.789523 17436 raft_consensus.cc:729] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.789649 17436 consensus_queue.cc:260] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.789778 17434 raft_consensus.cc:348] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.789920 17434 raft_consensus.cc:374] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.789933 17436 ts_tablet_manager.cc:1428] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:57:39.789963 17434 raft_consensus.cc:729] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.789899 17442 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:39.790046 17442 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:39.790103 17434 consensus_queue.cc:260] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.790395 17434 ts_tablet_manager.cc:1428] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260809 01:57:39.790887 17435 tablet_bootstrap.cc:492] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: No bootstrap required, opened a new log
I20260809 01:57:39.791002 17435 ts_tablet_manager.cc:1397] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 01:57:39.791110 17440 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:39.791256 17440 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:39.791518 17435 raft_consensus.cc:348] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.791622 17435 raft_consensus.cc:374] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:39.791646 17435 raft_consensus.cc:729] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Initialized, Role: FOLLOWER
I20260809 01:57:39.791778 17435 consensus_queue.cc:260] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:39.792074 17435 ts_tablet_manager.cc:1428] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:57:39.792030 17441 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:39.792152 17441 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 01:57:39.877640 17411 tablet.cc:2369] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:57:39.912788 17262 tablet.cc:2369] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:57:39.943184 17109 tablet.cc:2369] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:40.170814 17442 raft_consensus.cc:482] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:40.171025 17442 raft_consensus.cc:504] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.172209 17442 leader_election.cc:288] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645)
I20260809 01:57:40.176165 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.172556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:58845 (local address 127.14.175.195:45645)
0809 01:57:40.172683 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.172687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.172887 (+ 200us) server_negotiation.cc:407] Connection header received
0809 01:57:40.172964 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.172968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.173043 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.173117 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:40.173533 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.174010 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175170 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.175586 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175681 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.175761 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.175948 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.176028 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:57:40.176210 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.172499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53085 (local address 127.14.175.193:46721)
0809 01:57:40.172635 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.172640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.172812 (+ 172us) server_negotiation.cc:407] Connection header received
0809 01:57:40.172965 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.172968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.173023 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.173113 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:40.173445 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.173992 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175226 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.175622 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175759 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.175812 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.176023 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.176106 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:57:40.176213 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.172468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45645 (local address 127.14.175.194:58845)
0809 01:57:40.172798 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:40.172810 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:40.172890 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:40.173236 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:40.173239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:40.173257 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:40.173407 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.173414 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.174144 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.174147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.175047 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.175063 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.175706 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175713 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.175808 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.175841 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 01:57:40.175920 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 01:57:40.176018 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":37,"thread_start_us":86,"threads_started":1}
I20260809 01:57:40.176225 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.172382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46721 (local address 127.14.175.194:53085)
0809 01:57:40.172709 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:40.172724 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:40.172848 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:40.173143 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:40.173148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:40.173170 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:40.173327 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.173334 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.174108 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.174112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.175084 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.175093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.175769 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.175775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.175872 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.175910 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 01:57:40.175989 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 01:57:40.176060 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":28,"thread_start_us":77,"threads_started":1}
I20260809 01:57:40.176980 17359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b70bbf20c24f71b14b3d5a529db8a0" candidate_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71" is_pre_election: true
I20260809 01:57:40.177139 17359 raft_consensus.cc:2454] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f383ca275d1427ea0e5d0cd1e41b4cb in term 0.
I20260809 01:57:40.177125 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b70bbf20c24f71b14b3d5a529db8a0" candidate_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940" is_pre_election: true
I20260809 01:57:40.177345 17060 raft_consensus.cc:2454] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f383ca275d1427ea0e5d0cd1e41b4cb in term 0.
I20260809 01:57:40.177495 17136 leader_election.cc:302] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 7e79a497071b4cd7aca3b34258d78b71; no voters:
I20260809 01:57:40.177798 17442 raft_consensus.cc:2781] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:40.177856 17442 raft_consensus.cc:482] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:40.177883 17442 raft_consensus.cc:3037] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.178882 17442 raft_consensus.cc:504] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.179257 17442 leader_election.cc:288] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645)
I20260809 01:57:40.179627 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b70bbf20c24f71b14b3d5a529db8a0" candidate_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940"
I20260809 01:57:40.179615 17359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b70bbf20c24f71b14b3d5a529db8a0" candidate_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71"
I20260809 01:57:40.179742 17359 raft_consensus.cc:3037] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.179742 17060 raft_consensus.cc:3037] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.180874 17359 raft_consensus.cc:2454] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f383ca275d1427ea0e5d0cd1e41b4cb in term 1.
I20260809 01:57:40.180874 17060 raft_consensus.cc:2454] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f383ca275d1427ea0e5d0cd1e41b4cb in term 1.
I20260809 01:57:40.181160 17136 leader_election.cc:302] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 7e79a497071b4cd7aca3b34258d78b71; no voters:
I20260809 01:57:40.181362 17442 raft_consensus.cc:2781] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:40.181526 17442 raft_consensus.cc:686] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Running, Role: LEADER
I20260809 01:57:40.181850 17442 consensus_queue.cc:237] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.184088 17459 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: TxnStatusTablet state changed. Reason: New leader 6f383ca275d1427ea0e5d0cd1e41b4cb. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.184206 17459 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:40.184514 17461 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 01:57:40.184737 17461 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 01:57:40.185099 16896 catalog_manager.cc:5495] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194). New cstate: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } health_report { overall_health: UNKNOWN } } }
I20260809 01:57:40.241899 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.237855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48098 (local address 127.14.175.194:38861)
0809 01:57:40.238146 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.238150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.238166 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:57:40.238249 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.238251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.238303 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.238419 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:40.238682 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.239449 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.240384 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.240634 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.240748 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.241056 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.241458 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.241593 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.241678 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.241732 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
I20260809 01:57:40.241875 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.237719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.0.0.1:48098)
0809 01:57:40.237900 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:40.237916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:40.238033 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:40.238431 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:40.238434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:40.238442 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:40.238565 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.238571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.239564 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.239570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.240262 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.240271 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.240748 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.240752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.240851 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.240893 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.241564 (+ 671us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.241581 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 01:57:40.241670 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 01:57:40.241747 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 01:57:40.246451 17441 consensus_queue.cc:1035] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:40.247040 17359 raft_consensus.cc:1261] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Refusing update from remote peer 6f383ca275d1427ea0e5d0cd1e41b4cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:40.247572 17060 raft_consensus.cc:1261] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Refusing update from remote peer 6f383ca275d1427ea0e5d0cd1e41b4cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:40.247583 17459 consensus_queue.cc:1035] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:40.248155 17459 consensus_queue.cc:1035] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:40.251128 17441 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: TxnStatusTablet state changed. Reason: New leader 6f383ca275d1427ea0e5d0cd1e41b4cb. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.251235 17441 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:40.252728 17459 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.252838 17459 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:40.253122 17440 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: TxnStatusTablet state changed. Reason: New leader 6f383ca275d1427ea0e5d0cd1e41b4cb. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.253235 17440 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:40.253963 17441 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.254081 17441 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 8edd82dc356c4316a14940012ea40940: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:40.256109 17465 mvcc.cc:205] Tried to move back new op lower bound from 7316441744366211072 to 7316441744107438080. Current Snapshot: MvccSnapshot[applied={T|T < 7316441744366211072 or (T in {7316441744366211072})}]
I20260809 01:57:40.258391 17441 consensus_queue.cc:1035] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:40.260766 17468 mvcc.cc:205] Tried to move back new op lower bound from 7316441744366211072 to 7316441744107438080. Current Snapshot: MvccSnapshot[applied={T|T < 7316441744366211072}]
I20260809 01:57:40.262719 17442 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.262832 17442 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 6f383ca275d1427ea0e5d0cd1e41b4cb: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:57:40.263306 17440 tablet_replica.cc:439] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } } }
I20260809 01:57:40.263417 17440 tablet_replica.cc:442] T 92b70bbf20c24f71b14b3d5a529db8a0 P 7e79a497071b4cd7aca3b34258d78b71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:57:40.265313 17470 mvcc.cc:205] Tried to move back new op lower bound from 7316441744366211072 to 7316441744107438080. Current Snapshot: MvccSnapshot[applied={T|T < 7316441744366211072}]
I20260809 01:57:40.271581 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.267625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43590 (local address 127.14.175.193:46721)
0809 01:57:40.267772 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.267776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.267959 (+ 183us) server_negotiation.cc:407] Connection header received
0809 01:57:40.268117 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.268119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.268166 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.268247 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:40.268526 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.269009 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.270236 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.270438 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.270519 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.270798 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.271209 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.271296 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.271404 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.271445 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 01:57:40.281970 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.278590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:41277 (local address 127.14.175.194:38861)
0809 01:57:40.278740 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.278746 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.278997 (+ 251us) server_negotiation.cc:407] Connection header received
0809 01:57:40.279152 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.279155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.279214 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.279294 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:40.279544 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.280039 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.280914 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.281147 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.281269 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.281565 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.281628 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.281706 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.281795 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.281842 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 01:57:40.281975 17483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.278490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.14.175.193:41277)
0809 01:57:40.278888 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:40.278899 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:40.279040 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:40.279304 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:40.279306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:40.279314 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:40.279418 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.279424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.280150 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.280155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.280788 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.280797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.281259 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.281263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.281354 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.281401 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.281712 (+ 311us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.281721 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 01:57:40.281787 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 01:57:40.281856 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":123,"threads_started":1}
I20260809 01:57:40.309320 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.305674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:59607 (local address 127.14.175.193:46721)
0809 01:57:40.305770 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:40.305774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:40.305787 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:57:40.305883 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:40.305886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:40.305932 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:40.306015 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:40.306168 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.306941 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.308098 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.308331 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.308436 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.308861 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.308943 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.309019 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:40.309113 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 01:57:40.309169 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 01:57:40.309378 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:40.305405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46721 (local address 127.14.175.194:59607)
0809 01:57:40.305693 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:40.305710 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:40.305810 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:40.306018 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:40.306019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:40.306024 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:40.306107 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.306111 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.307075 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.307078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.307970 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:40.307979 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:40.308448 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:40.308452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:40.308553 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:40.308594 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:40.309024 (+ 430us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:40.309034 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 01:57:40.309107 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 01:57:40.309184 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":61,"threads_started":1}
I20260809 01:57:40.333983 16894 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:40.334190 16894 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:40.336972 16894 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Sending DeleteTablet for 3 replicas of tablet 92c098c3e30e4c0ab27cfe26eed3145c
I20260809 01:57:40.337668 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:40 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:43582
I20260809 01:57:40.337931 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:40 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:48096
I20260809 01:57:40.338578 17337 tablet_service.cc:1514] Processing DeleteTablet for tablet 92c098c3e30e4c0ab27cfe26eed3145c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:40 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:55558
I20260809 01:57:40.339061 17496 tablet_replica.cc:330] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: stopping tablet replica
I20260809 01:57:40.339187 16894 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 01:57:40.339381 17496 raft_consensus.cc:2229] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:40.339640 17496 raft_consensus.cc:2258] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 01:57:40.339640 16894 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:40.341075 17496 ts_tablet_manager.cc:1905] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:40.341638 17492 tablet_replica.cc:330] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: stopping tablet replica
I20260809 01:57:40.341980 17492 raft_consensus.cc:2229] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:40.342367 17492 raft_consensus.cc:2258] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:40.345927 17191 tablet_service.cc:1467] Processing CreateTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 (DEFAULT_TABLE table=test-table [id=8a8a503175974fd7a029a9c76401c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:40.346207 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7c01b6859464a1188fc3ad3daf180b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:40.347062 17496 ts_tablet_manager.cc:1918] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:40.347142 17496 log.cc:1196] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/92c098c3e30e4c0ab27cfe26eed3145c
I20260809 01:57:40.347476 17496 ts_tablet_manager.cc:1939] T 92c098c3e30e4c0ab27cfe26eed3145c P 7e79a497071b4cd7aca3b34258d78b71: Deleting consensus metadata
I20260809 01:57:40.348695 16881 catalog_manager.cc:4841] TS 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645): tablet 92c098c3e30e4c0ab27cfe26eed3145c (table test-table [id=6f2219ce8576467786292d7d8e74e775]) successfully deleted
I20260809 01:57:40.348896 17337 tablet_service.cc:1467] Processing CreateTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 (DEFAULT_TABLE table=test-table [id=8a8a503175974fd7a029a9c76401c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:40.349128 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7c01b6859464a1188fc3ad3daf180b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:40.351169 17497 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Bootstrap starting.
I20260809 01:57:40.351858 17495 tablet_replica.cc:330] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: stopping tablet replica
I20260809 01:57:40.351831 17039 tablet_service.cc:1467] Processing CreateTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 (DEFAULT_TABLE table=test-table [id=8a8a503175974fd7a029a9c76401c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:40.352088 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7c01b6859464a1188fc3ad3daf180b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:40.352180 17497 tablet_bootstrap.cc:654] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:40.352301 17492 ts_tablet_manager.cc:1905] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:40.352489 17495 raft_consensus.cc:2229] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:40.352813 17495 raft_consensus.cc:2258] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:40.355726 17500 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Bootstrap starting.
I20260809 01:57:40.356256 17495 ts_tablet_manager.cc:1905] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:40.356665 17500 tablet_bootstrap.cc:654] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:40.357384 17498 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Bootstrap starting.
I20260809 01:57:40.358305 17498 tablet_bootstrap.cc:654] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:40.358875 17492 ts_tablet_manager.cc:1918] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:40.359604 17497 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: No bootstrap required, opened a new log
I20260809 01:57:40.359704 17497 ts_tablet_manager.cc:1397] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260809 01:57:40.359789 17492 log.cc:1196] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/92c098c3e30e4c0ab27cfe26eed3145c
I20260809 01:57:40.359838 17498 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: No bootstrap required, opened a new log
I20260809 01:57:40.359923 17498 ts_tablet_manager.cc:1397] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 01:57:40.360209 17497 raft_consensus.cc:348] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.360327 17497 raft_consensus.cc:374] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:40.360369 17497 raft_consensus.cc:729] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Initialized, Role: FOLLOWER
I20260809 01:57:40.360344 17498 raft_consensus.cc:348] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.360447 17498 raft_consensus.cc:374] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:40.360481 17498 raft_consensus.cc:729] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Initialized, Role: FOLLOWER
I20260809 01:57:40.360528 17497 consensus_queue.cc:260] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.360611 17498 consensus_queue.cc:260] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.361495 17497 ts_tablet_manager.cc:1428] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:40.361903 17492 ts_tablet_manager.cc:1939] T 92c098c3e30e4c0ab27cfe26eed3145c P 8edd82dc356c4316a14940012ea40940: Deleting consensus metadata
I20260809 01:57:40.363785 16882 catalog_manager.cc:4841] TS 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721): tablet 92c098c3e30e4c0ab27cfe26eed3145c (table test-table [id=6f2219ce8576467786292d7d8e74e775]) successfully deleted
I20260809 01:57:40.363960 17495 ts_tablet_manager.cc:1918] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:40.364097 17495 log.cc:1196] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/92c098c3e30e4c0ab27cfe26eed3145c
I20260809 01:57:40.364451 17495 ts_tablet_manager.cc:1939] T 92c098c3e30e4c0ab27cfe26eed3145c P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting consensus metadata
I20260809 01:57:40.365147 17498 ts_tablet_manager.cc:1428] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260809 01:57:40.365540 16881 catalog_manager.cc:4841] TS 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861): tablet 92c098c3e30e4c0ab27cfe26eed3145c (table test-table [id=6f2219ce8576467786292d7d8e74e775]) successfully deleted
I20260809 01:57:40.367694 17500 tablet_bootstrap.cc:492] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: No bootstrap required, opened a new log
I20260809 01:57:40.367784 17500 ts_tablet_manager.cc:1397] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260809 01:57:40.368235 17500 raft_consensus.cc:348] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.368373 17500 raft_consensus.cc:374] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:40.368405 17500 raft_consensus.cc:729] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Initialized, Role: FOLLOWER
I20260809 01:57:40.368534 17500 consensus_queue.cc:260] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.368789 17500 ts_tablet_manager.cc:1428] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:40.370374 17473 raft_consensus.cc:482] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:40.370467 17473 raft_consensus.cc:504] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.370810 17473 leader_election.cc:288] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861), 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645)
I20260809 01:57:40.371179 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7c01b6859464a1188fc3ad3daf180b1" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" is_pre_election: true
I20260809 01:57:40.371270 17358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7c01b6859464a1188fc3ad3daf180b1" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71" is_pre_election: true
I20260809 01:57:40.371313 17202 raft_consensus.cc:2454] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 0.
I20260809 01:57:40.371389 17358 raft_consensus.cc:2454] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 0.
I20260809 01:57:40.371610 16990 leader_election.cc:302] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:40.371784 17473 raft_consensus.cc:2781] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:40.371841 17473 raft_consensus.cc:482] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:40.371884 17473 raft_consensus.cc:3037] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.372953 17473 raft_consensus.cc:504] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.373268 17473 leader_election.cc:288] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 election: Requested vote from peers 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861), 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645)
I20260809 01:57:40.373617 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7c01b6859464a1188fc3ad3daf180b1" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
I20260809 01:57:40.373621 17358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7c01b6859464a1188fc3ad3daf180b1" candidate_uuid: "8edd82dc356c4316a14940012ea40940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e79a497071b4cd7aca3b34258d78b71"
I20260809 01:57:40.373713 17202 raft_consensus.cc:3037] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.373718 17358 raft_consensus.cc:3037] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:40.374625 17202 raft_consensus.cc:2454] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 1.
I20260809 01:57:40.374822 17358 raft_consensus.cc:2454] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8edd82dc356c4316a14940012ea40940 in term 1.
I20260809 01:57:40.375123 16990 leader_election.cc:302] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:40.375320 17473 raft_consensus.cc:2781] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:40.375389 17473 raft_consensus.cc:686] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 1 LEADER]: Becoming Leader. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Running, Role: LEADER
I20260809 01:57:40.375510 17473 consensus_queue.cc:237] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:40.376982 16894 catalog_manager.cc:5495] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8edd82dc356c4316a14940012ea40940 (127.14.175.193). New cstate: current_term: 1 leader_uuid: "8edd82dc356c4316a14940012ea40940" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } health_report { overall_health: UNKNOWN } } }
I20260809 01:57:40.395911 17202 raft_consensus.cc:1261] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Refusing update from remote peer 8edd82dc356c4316a14940012ea40940: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:40.395905 17358 raft_consensus.cc:1261] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Refusing update from remote peer 8edd82dc356c4316a14940012ea40940: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:40.396284 17473 consensus_queue.cc:1035] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:40.396814 17484 consensus_queue.cc:1035] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 01:57:40.410125 17474 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 01:57:41.969218 16896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:41.969364 16896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:41.971964 16896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Sending DeleteTablet for 3 replicas of tablet a7c01b6859464a1188fc3ad3daf180b1
I20260809 01:57:41.972532 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:41 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:43582
I20260809 01:57:41.972625 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:41 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:48096
I20260809 01:57:41.972625 17337 tablet_service.cc:1514] Processing DeleteTablet for tablet a7c01b6859464a1188fc3ad3daf180b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:41 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:55558
I20260809 01:57:41.972889 17531 tablet_replica.cc:330] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: stopping tablet replica
I20260809 01:57:41.972997 17532 tablet_replica.cc:330] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: stopping tablet replica
I20260809 01:57:41.973037 17531 raft_consensus.cc:2229] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:41.973157 17532 raft_consensus.cc:2229] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:41.973265 17531 raft_consensus.cc:2258] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:41.973302 17532 raft_consensus.cc:2258] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:41.973569 17534 tablet_replica.cc:330] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: stopping tablet replica
I20260809 01:57:41.973714 17534 raft_consensus.cc:2229] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:41.973842 17534 raft_consensus.cc:2258] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:41.974133 17532 ts_tablet_manager.cc:1905] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:41.974164 17531 ts_tablet_manager.cc:1905] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:41.977131 17534 ts_tablet_manager.cc:1905] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:41.977306 17532 ts_tablet_manager.cc:1918] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 01:57:41.977401 17532 log.cc:1196] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/a7c01b6859464a1188fc3ad3daf180b1
I20260809 01:57:41.977674 17532 ts_tablet_manager.cc:1939] T a7c01b6859464a1188fc3ad3daf180b1 P 7e79a497071b4cd7aca3b34258d78b71: Deleting consensus metadata
I20260809 01:57:41.977787 17531 ts_tablet_manager.cc:1918] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 01:57:41.977869 17531 log.cc:1196] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/a7c01b6859464a1188fc3ad3daf180b1
I20260809 01:57:41.978168 17531 ts_tablet_manager.cc:1939] T a7c01b6859464a1188fc3ad3daf180b1 P 8edd82dc356c4316a14940012ea40940: Deleting consensus metadata
I20260809 01:57:41.978387 16881 catalog_manager.cc:4841] TS 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645): tablet a7c01b6859464a1188fc3ad3daf180b1 (table test-table [id=8a8a503175974fd7a029a9c76401c772]) successfully deleted
I20260809 01:57:41.978859 16882 catalog_manager.cc:4841] TS 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721): tablet a7c01b6859464a1188fc3ad3daf180b1 (table test-table [id=8a8a503175974fd7a029a9c76401c772]) successfully deleted
I20260809 01:57:41.979837 17534 ts_tablet_manager.cc:1918] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 01:57:41.979929 17534 log.cc:1196] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/a7c01b6859464a1188fc3ad3daf180b1
I20260809 01:57:41.980165 17534 ts_tablet_manager.cc:1939] T a7c01b6859464a1188fc3ad3daf180b1 P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting consensus metadata
I20260809 01:57:41.981009 16881 catalog_manager.cc:4841] TS 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861): tablet a7c01b6859464a1188fc3ad3daf180b1 (table test-table [id=8a8a503175974fd7a029a9c76401c772]) successfully deleted
Aug 09 01:57:41 dist-test-slave-2w3w krb5kdc[16848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240661, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 01:57:42 dist-test-slave-2w3w krb5kdc[16848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240661, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:42.008240 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:41.995581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.14.175.254:34777)
0809 01:57:41.996133 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:41.996141 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:41.996156 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:41.996202 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:41.996204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:41.996246 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:41.996334 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:41.997109 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:41.997733 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:41.998642 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:41.999029 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:41.999129 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.005108 (+ 5979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:42.005112 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:42.005114 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:42.005143 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:42.006732 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:42.007219 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:42.007222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:42.007223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:42.007300 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:42.007528 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:42.007529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:42.007531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:42.007705 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:42.007802 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.007995 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.008103 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":126,"threads_started":1}
I20260809 01:57:42.011116 16896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:42.011595 16896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:42.016513 17191 tablet_service.cc:1467] Processing CreateTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e (DEFAULT_TABLE table=test-table [id=9de6ad61f25540cdb7a811070fc1456c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.016505 17337 tablet_service.cc:1467] Processing CreateTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e (DEFAULT_TABLE table=test-table [id=9de6ad61f25540cdb7a811070fc1456c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.016597 17039 tablet_service.cc:1467] Processing CreateTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e (DEFAULT_TABLE table=test-table [id=9de6ad61f25540cdb7a811070fc1456c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.016836 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c62ed0c7ee472ab7ff76117c8df14e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.016836 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c62ed0c7ee472ab7ff76117c8df14e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.016945 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c62ed0c7ee472ab7ff76117c8df14e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.019047 17543 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Bootstrap starting.
I20260809 01:57:42.019418 17544 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Bootstrap starting.
I20260809 01:57:42.020004 17546 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Bootstrap starting.
I20260809 01:57:42.020124 17543 tablet_bootstrap.cc:654] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.020212 17544 tablet_bootstrap.cc:654] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.020912 17546 tablet_bootstrap.cc:654] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.021360 17544 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: No bootstrap required, opened a new log
I20260809 01:57:42.021420 17543 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: No bootstrap required, opened a new log
I20260809 01:57:42.021464 17544 ts_tablet_manager.cc:1397] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:42.021489 17543 ts_tablet_manager.cc:1397] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:42.021885 17543 raft_consensus.cc:348] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.021885 17544 raft_consensus.cc:348] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.022001 17544 raft_consensus.cc:374] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.022001 17543 raft_consensus.cc:374] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.022037 17544 raft_consensus.cc:729] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.022037 17543 raft_consensus.cc:729] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.022106 17546 tablet_bootstrap.cc:492] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: No bootstrap required, opened a new log
I20260809 01:57:42.022188 17546 ts_tablet_manager.cc:1397] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:42.022184 17544 consensus_queue.cc:260] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.022184 17543 consensus_queue.cc:260] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.022527 17544 ts_tablet_manager.cc:1428] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:42.022646 17546 raft_consensus.cc:348] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.022753 17546 raft_consensus.cc:374] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.022785 17546 raft_consensus.cc:729] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.022912 17546 consensus_queue.cc:260] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.023105 17543 ts_tablet_manager.cc:1428] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:42.023339 17546 ts_tablet_manager.cc:1428] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:42.102646 17550 raft_consensus.cc:482] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:42.102833 17550 raft_consensus.cc:504] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.103929 17550 leader_election.cc:288] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:42.109622 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.104253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33585 (local address 127.14.175.194:38861)
0809 01:57:42.104591 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:42.104601 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:42.104715 (+ 114us) server_negotiation.cc:407] Connection header received
0809 01:57:42.104877 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:42.104880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:42.104933 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:42.105035 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:42.105452 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.106268 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.108207 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.108859 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.108971 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.109024 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.109386 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.109463 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":113,"threads_started":1}
I20260809 01:57:42.109607 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.104249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:47565 (local address 127.14.175.193:46721)
0809 01:57:42.104591 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:42.104601 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:42.104715 (+ 114us) server_negotiation.cc:407] Connection header received
0809 01:57:42.104877 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:42.104880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:42.104933 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:42.105040 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:42.105452 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.106268 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.108207 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.108833 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.108971 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.109030 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.109386 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.109463 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":116,"threads_started":1}
I20260809 01:57:42.109629 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.104156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.14.175.195:33585)
0809 01:57:42.104597 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:42.104613 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:42.104757 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:42.105062 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:42.105066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:42.105092 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:42.105313 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.105321 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.106412 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.106418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.108078 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.108087 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.109009 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.109014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.109219 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.109273 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 01:57:42.109351 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 01:57:42.109446 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":357,"spinlock_wait_cycles":27776,"thread_start_us":139,"threads_started":1}
I20260809 01:57:42.109637 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.104156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46721 (local address 127.14.175.195:47565)
0809 01:57:42.104622 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:42.104635 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:42.104757 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:42.105062 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:42.105065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:42.105092 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:42.105340 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.105347 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.106423 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.106425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.108076 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.108087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.109009 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.109014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.109224 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.109266 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 01:57:42.109353 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 01:57:42.109446 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"mutex_wait_us":268,"spinlock_wait_cycles":15744,"thread_start_us":127,"threads_started":1}
I20260809 01:57:42.110253 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c62ed0c7ee472ab7ff76117c8df14e" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" is_pre_election: true
I20260809 01:57:42.110411 17202 raft_consensus.cc:2454] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 0.
I20260809 01:57:42.110400 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c62ed0c7ee472ab7ff76117c8df14e" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940" is_pre_election: true
I20260809 01:57:42.110558 17060 raft_consensus.cc:2454] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 0.
I20260809 01:57:42.110898 17289 leader_election.cc:302] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 7e79a497071b4cd7aca3b34258d78b71, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:42.111223 17550 raft_consensus.cc:2781] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:42.111284 17550 raft_consensus.cc:482] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:42.111312 17550 raft_consensus.cc:3037] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.112362 17550 raft_consensus.cc:504] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.112725 17550 leader_election.cc:288] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 election: Requested vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:42.113137 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c62ed0c7ee472ab7ff76117c8df14e" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940"
I20260809 01:57:42.113137 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c62ed0c7ee472ab7ff76117c8df14e" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
I20260809 01:57:42.113267 17060 raft_consensus.cc:3037] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.113288 17202 raft_consensus.cc:3037] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.114406 17060 raft_consensus.cc:2454] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 1.
I20260809 01:57:42.114406 17202 raft_consensus.cc:2454] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 1.
I20260809 01:57:42.114743 17290 leader_election.cc:302] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6f383ca275d1427ea0e5d0cd1e41b4cb, 7e79a497071b4cd7aca3b34258d78b71, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:42.115023 17550 raft_consensus.cc:2781] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:42.115275 17550 raft_consensus.cc:686] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 1 LEADER]: Becoming Leader. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Running, Role: LEADER
I20260809 01:57:42.115535 17550 consensus_queue.cc:237] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.118115 16894 catalog_manager.cc:5495] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195). New cstate: current_term: 1 leader_uuid: "7e79a497071b4cd7aca3b34258d78b71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } health_report { overall_health: HEALTHY } } }
I20260809 01:57:42.153033 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.149621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55566 (local address 127.14.175.195:45645)
0809 01:57:42.149885 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:42.149891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:42.149903 (+ 12us) server_negotiation.cc:407] Connection header received
0809 01:57:42.149970 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:42.149972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:42.150022 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:42.150124 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:42.150342 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.150880 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.151717 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.151944 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.152017 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.152279 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:42.152722 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:42.152806 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.152869 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.152912 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":121,"threads_started":1}
I20260809 01:57:42.162717 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.159322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38861 (local address 127.14.175.195:48249)
0809 01:57:42.159674 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:42.159686 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:42.159800 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:42.160058 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:42.160062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:42.160069 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:42.160186 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.160192 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.160902 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.160905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.161508 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.161516 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.161981 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.161984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.162083 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.162120 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:42.162425 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:42.162434 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 01:57:42.162498 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 01:57:42.162572 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":135,"threads_started":1}
I20260809 01:57:42.162698 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.159475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48249 (local address 127.14.175.194:38861)
0809 01:57:42.159606 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:42.159610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:42.159755 (+ 145us) server_negotiation.cc:407] Connection header received
0809 01:57:42.159910 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:42.159913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:42.159963 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:42.160046 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:42.160287 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.160788 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.161628 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.161862 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.161972 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.162265 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:42.162335 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:42.162418 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.162508 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.162561 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:57:42.168545 17202 raft_consensus.cc:1261] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Refusing update from remote peer 7e79a497071b4cd7aca3b34258d78b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:42.168586 17060 raft_consensus.cc:1261] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Refusing update from remote peer 7e79a497071b4cd7aca3b34258d78b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:42.169045 17555 consensus_queue.cc:1035] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:42.169206 17550 consensus_queue.cc:1035] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:42.187060 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.183641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45645 (local address 127.14.175.194:50613)
0809 01:57:42.183914 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:42.183927 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:42.184013 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:42.184184 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:42.184186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:42.184191 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:57:42.184275 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.184279 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.184924 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.184926 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.185830 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:42.185842 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.186312 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.186315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:42.186399 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.186435 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:57:42.186753 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:57:42.186763 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 01:57:42.186829 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 01:57:42.186907 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":126,"threads_started":1}
I20260809 01:57:42.187054 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:42.183682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:50613 (local address 127.14.175.195:45645)
0809 01:57:42.183823 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:42.183827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:42.183987 (+ 160us) server_negotiation.cc:407] Connection header received
0809 01:57:42.184088 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:42.184090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:42.184129 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:42.184181 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:42.184335 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.184825 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.185955 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:42.186199 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:42.186315 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:42.186588 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:42.186668 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:42.186748 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:42.186838 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 01:57:42.186889 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 01:57:42.216073 16896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:42.216279 16896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:42.218394 16896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Sending DeleteTablet for 3 replicas of tablet f7c62ed0c7ee472ab7ff76117c8df14e
I20260809 01:57:42.219010 17337 tablet_service.cc:1514] Processing DeleteTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:42 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:55558
I20260809 01:57:42.219017 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:42 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:43582
I20260809 01:57:42.219199 17532 tablet_replica.cc:330] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: stopping tablet replica
I20260809 01:57:42.219216 17531 tablet_replica.cc:330] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: stopping tablet replica
I20260809 01:57:42.219302 17532 raft_consensus.cc:2229] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:42.219323 17531 raft_consensus.cc:2229] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:42.219434 17531 raft_consensus.cc:2258] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:42.219578 17532 raft_consensus.cc:2258] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:42.219870 16896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 01:57:42.220022 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet f7c62ed0c7ee472ab7ff76117c8df14e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:42 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:48096
I20260809 01:57:42.220208 17534 tablet_replica.cc:330] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: stopping tablet replica
W20260809 01:57:42.220281 16896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:42.220340 17534 raft_consensus.cc:2229] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:42.220458 17534 raft_consensus.cc:2258] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:42.220907 17531 ts_tablet_manager.cc:1905] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:42.221113 17534 ts_tablet_manager.cc:1905] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:42.223886 17534 ts_tablet_manager.cc:1918] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:42.223973 17534 log.cc:1196] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/f7c62ed0c7ee472ab7ff76117c8df14e
I20260809 01:57:42.224241 17534 ts_tablet_manager.cc:1939] T f7c62ed0c7ee472ab7ff76117c8df14e P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting consensus metadata
I20260809 01:57:42.224330 17532 ts_tablet_manager.cc:1905] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:42.225116 16881 catalog_manager.cc:4841] TS 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861): tablet f7c62ed0c7ee472ab7ff76117c8df14e (table test-table [id=9de6ad61f25540cdb7a811070fc1456c]) successfully deleted
I20260809 01:57:42.226854 17532 ts_tablet_manager.cc:1918] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:42.226940 17532 log.cc:1196] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/f7c62ed0c7ee472ab7ff76117c8df14e
I20260809 01:57:42.226890 17531 ts_tablet_manager.cc:1918] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:57:42.227154 17531 log.cc:1196] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/f7c62ed0c7ee472ab7ff76117c8df14e
I20260809 01:57:42.227277 17532 ts_tablet_manager.cc:1939] T f7c62ed0c7ee472ab7ff76117c8df14e P 7e79a497071b4cd7aca3b34258d78b71: Deleting consensus metadata
I20260809 01:57:42.227517 17531 ts_tablet_manager.cc:1939] T f7c62ed0c7ee472ab7ff76117c8df14e P 8edd82dc356c4316a14940012ea40940: Deleting consensus metadata
I20260809 01:57:42.227738 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 119a7d47b18f496f9445b644edae553a (DEFAULT_TABLE table=test-table [id=2fb83ef532f848c090834da1f66780d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.228037 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119a7d47b18f496f9445b644edae553a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.228132 16881 catalog_manager.cc:4841] TS 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645): tablet f7c62ed0c7ee472ab7ff76117c8df14e (table test-table [id=9de6ad61f25540cdb7a811070fc1456c]) successfully deleted
I20260809 01:57:42.228698 17337 tablet_service.cc:1467] Processing CreateTablet for tablet 119a7d47b18f496f9445b644edae553a (DEFAULT_TABLE table=test-table [id=2fb83ef532f848c090834da1f66780d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.228916 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119a7d47b18f496f9445b644edae553a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.229480 17191 tablet_service.cc:1467] Processing CreateTablet for tablet 119a7d47b18f496f9445b644edae553a (DEFAULT_TABLE table=test-table [id=2fb83ef532f848c090834da1f66780d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:42.229720 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119a7d47b18f496f9445b644edae553a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:42.230315 17543 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: Bootstrap starting.
I20260809 01:57:42.231091 17546 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Bootstrap starting.
I20260809 01:57:42.231247 17543 tablet_bootstrap.cc:654] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.231781 16882 catalog_manager.cc:4841] TS 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721): tablet f7c62ed0c7ee472ab7ff76117c8df14e (table test-table [id=9de6ad61f25540cdb7a811070fc1456c]) successfully deleted
I20260809 01:57:42.232093 17546 tablet_bootstrap.cc:654] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.232741 17544 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Bootstrap starting.
I20260809 01:57:42.233474 17543 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: No bootstrap required, opened a new log
I20260809 01:57:42.233566 17543 ts_tablet_manager.cc:1397] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 01:57:42.233574 17544 tablet_bootstrap.cc:654] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:42.233950 17543 raft_consensus.cc:348] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.234087 17543 raft_consensus.cc:374] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.234126 17543 raft_consensus.cc:729] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edd82dc356c4316a14940012ea40940, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.234241 17543 consensus_queue.cc:260] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.234486 17543 ts_tablet_manager.cc:1428] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:57:42.234876 17544 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: No bootstrap required, opened a new log
I20260809 01:57:42.234876 17546 tablet_bootstrap.cc:492] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: No bootstrap required, opened a new log
I20260809 01:57:42.234949 17544 ts_tablet_manager.cc:1397] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:42.234949 17546 ts_tablet_manager.cc:1397] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 01:57:42.235368 17544 raft_consensus.cc:348] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.235394 17546 raft_consensus.cc:348] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.235476 17544 raft_consensus.cc:374] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.235492 17546 raft_consensus.cc:374] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:42.235513 17544 raft_consensus.cc:729] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f383ca275d1427ea0e5d0cd1e41b4cb, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.235529 17546 raft_consensus.cc:729] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Initialized, Role: FOLLOWER
I20260809 01:57:42.235637 17544 consensus_queue.cc:260] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.235637 17546 consensus_queue.cc:260] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.235877 17546 ts_tablet_manager.cc:1428] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 01:57:42.235901 17544 ts_tablet_manager.cc:1428] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 01:57:42.263428 17550 raft_consensus.cc:482] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:42.263540 17550 raft_consensus.cc:504] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.264004 17550 leader_election.cc:288] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:42.264389 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119a7d47b18f496f9445b644edae553a" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" is_pre_election: true
I20260809 01:57:42.264389 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119a7d47b18f496f9445b644edae553a" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940" is_pre_election: true
I20260809 01:57:42.264536 17060 raft_consensus.cc:2454] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 0.
I20260809 01:57:42.264537 17202 raft_consensus.cc:2454] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 0.
I20260809 01:57:42.264832 17290 leader_election.cc:302] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e79a497071b4cd7aca3b34258d78b71, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:42.265034 17550 raft_consensus.cc:2781] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:42.265117 17550 raft_consensus.cc:482] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:42.265172 17550 raft_consensus.cc:3037] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.266134 17550 raft_consensus.cc:504] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.266486 17550 leader_election.cc:288] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 election: Requested vote from peers 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721), 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861)
I20260809 01:57:42.266817 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119a7d47b18f496f9445b644edae553a" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8edd82dc356c4316a14940012ea40940"
I20260809 01:57:42.266872 17202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119a7d47b18f496f9445b644edae553a" candidate_uuid: "7e79a497071b4cd7aca3b34258d78b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb"
I20260809 01:57:42.266943 17060 raft_consensus.cc:3037] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.266995 17202 raft_consensus.cc:3037] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:42.268124 17202 raft_consensus.cc:2454] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 1.
I20260809 01:57:42.268124 17060 raft_consensus.cc:2454] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e79a497071b4cd7aca3b34258d78b71 in term 1.
I20260809 01:57:42.268414 17290 leader_election.cc:302] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e79a497071b4cd7aca3b34258d78b71, 8edd82dc356c4316a14940012ea40940; no voters:
I20260809 01:57:42.268685 17550 raft_consensus.cc:2781] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:42.268782 17550 raft_consensus.cc:686] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 1 LEADER]: Becoming Leader. State: Replica: 7e79a497071b4cd7aca3b34258d78b71, State: Running, Role: LEADER
I20260809 01:57:42.268919 17550 consensus_queue.cc:237] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } }
I20260809 01:57:42.270448 16894 catalog_manager.cc:5495] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195). New cstate: current_term: 1 leader_uuid: "7e79a497071b4cd7aca3b34258d78b71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e79a497071b4cd7aca3b34258d78b71" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45645 } health_report { overall_health: HEALTHY } } }
I20260809 01:57:42.294168 17202 raft_consensus.cc:1261] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Refusing update from remote peer 7e79a497071b4cd7aca3b34258d78b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:42.294155 17060 raft_consensus.cc:1261] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Refusing update from remote peer 7e79a497071b4cd7aca3b34258d78b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:42.294580 17555 consensus_queue.cc:1035] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8edd82dc356c4316a14940012ea40940" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:42.294869 17555 consensus_queue.cc:1035] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f383ca275d1427ea0e5d0cd1e41b4cb" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 01:57:42.309113 17512 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 01:57:43.861330 16896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:43.861572 16896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:43.864136 16896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9404110b87134d9e8d118cb790985f2b: Sending DeleteTablet for 3 replicas of tablet 119a7d47b18f496f9445b644edae553a
I20260809 01:57:43.864722 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 119a7d47b18f496f9445b644edae553a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:43 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:43582
I20260809 01:57:43.865062 17337 tablet_service.cc:1514] Processing DeleteTablet for tablet 119a7d47b18f496f9445b644edae553a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:43 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:55558
I20260809 01:57:43.865089 17600 tablet_replica.cc:330] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940: stopping tablet replica
I20260809 01:57:43.865229 17600 raft_consensus.cc:2229] T 119a7d47b18f496f9445b644edae553a P 8edd82dc356c4316a14940012ea40940 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:43.865247 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16971
I20260809 01:57:43.865360 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet 119a7d47b18f496f9445b644edae553a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:43 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:48096
I20260809 01:57:43.868202 17602 tablet_replica.cc:330] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: stopping tablet replica
I20260809 01:57:43.868382 17602 raft_consensus.cc:2229] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:43.868527 17602 raft_consensus.cc:2258] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:43.869328 17602 ts_tablet_manager.cc:1905] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:43.870342 17601 tablet_replica.cc:330] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: stopping tablet replica
I20260809 01:57:43.870493 17601 raft_consensus.cc:2229] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:43.870707 17601 raft_consensus.cc:2258] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:43.871281 17601 ts_tablet_manager.cc:1905] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:43.873068 17602 ts_tablet_manager.cc:1918] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 01:57:43.873323 17601 ts_tablet_manager.cc:1918] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 01:57:43.873414 17601 log.cc:1196] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/119a7d47b18f496f9445b644edae553a
I20260809 01:57:43.873426 17602 log.cc:1196] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/119a7d47b18f496f9445b644edae553a
I20260809 01:57:43.873713 17601 ts_tablet_manager.cc:1939] T 119a7d47b18f496f9445b644edae553a P 7e79a497071b4cd7aca3b34258d78b71: Deleting consensus metadata
I20260809 01:57:43.873737 17602 ts_tablet_manager.cc:1939] T 119a7d47b18f496f9445b644edae553a P 6f383ca275d1427ea0e5d0cd1e41b4cb: Deleting consensus metadata
I20260809 01:57:43.874351 16881 catalog_manager.cc:4841] TS 7e79a497071b4cd7aca3b34258d78b71 (127.14.175.195:45645): tablet 119a7d47b18f496f9445b644edae553a (table test-table [id=2fb83ef532f848c090834da1f66780d6]) successfully deleted
I20260809 01:57:43.874537 16881 catalog_manager.cc:4841] TS 6f383ca275d1427ea0e5d0cd1e41b4cb (127.14.175.194:38861): tablet 119a7d47b18f496f9445b644edae553a (table test-table [id=2fb83ef532f848c090834da1f66780d6]) successfully deleted
W20260809 01:57:43.879541 16882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:46721 (error 108)
I20260809 01:57:43.880398 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 17117
I20260809 01:57:43.881450 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:43.880242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46721 (local address 127.0.0.1:43600)
0809 01:57:43.881230 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:43.881325 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:46721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":108,"threads_started":1}
W20260809 01:57:43.882678 16882 catalog_manager.cc:4584] TS 8edd82dc356c4316a14940012ea40940 (127.14.175.193:46721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 119a7d47b18f496f9445b644edae553a: Network error: Client connection negotiation failed: client connection to 127.14.175.193:46721: connect: Connection refused (error 111)
I20260809 01:57:43.888809 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 17270
I20260809 01:57:43.896524 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 16863
2026-08-09T01:57:43Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6360 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:43 dist-test-slave-2w3w krb5kdc[17607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:43 dist-test-slave-2w3w krb5kdc[17607](info): set up 2 sockets
Aug 09 01:57:43 dist-test-slave-2w3w krb5kdc[17607](info): commencing operation
krb5kdc: starting...
W20260809 01:57:44.976490 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:45.103936 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41679
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:41679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:45.214596 17620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:45.214895 17620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:45.214938 17620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:45.218992 17620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:45.219056 17620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:45.219075 17620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:45.219092 17620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:45.219134 17620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:45.224532 17620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:41679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:45.225637 17620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:45.226696 17620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:45.235329 17626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:45.235321 17620 server_base.cc:1034] running on GCE node
W20260809 01:57:45.235356 17625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.235307 17628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:45.236220 17620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:45.237196 17620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:45.238437 17620 hybrid_clock.cc:648] HybridClock initialized: now 1786240665238423 us; error 35 us; skew 500 ppm
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:45.241297 17620 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:45.242123 17620 webserver.cc:460] Webserver started at http://127.14.175.254:42453/ using document root <none> and password file <none>
I20260809 01:57:45.242657 17620 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:45.242749 17620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:45.243057 17620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:45.245031 17620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "1a1b10fbe87d432fa3759c0f199c3306"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "105e4a7e7942b02b08dc26ed885acc25"
server_key_iv: "4da12452404bdd9e9f01e9ccbb37560e"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.245663 17620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "1a1b10fbe87d432fa3759c0f199c3306"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "105e4a7e7942b02b08dc26ed885acc25"
server_key_iv: "4da12452404bdd9e9f01e9ccbb37560e"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.249205 17620 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 01:57:45.251506 17636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.252668 17620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:45.252835 17620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "1a1b10fbe87d432fa3759c0f199c3306"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "105e4a7e7942b02b08dc26ed885acc25"
server_key_iv: "4da12452404bdd9e9f01e9ccbb37560e"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.252954 17620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:45.283509 17620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:45.286343 17620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:45.286550 17620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:45.293398 17620 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:41679
I20260809 01:57:45.293435 17692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:41679 every 8 connection(s)
I20260809 01:57:45.294345 17620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:45.297001 17693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:45.300693 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 17620
I20260809 01:57:45.300805 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:45.301101 15039 external_mini_cluster.cc:1428] Setting key 3a74605453689a0122f60cc7a270e60f
I20260809 01:57:45.303134 17693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: Bootstrap starting.
I20260809 01:57:45.305176 17693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:45.305897 17693 log.cc:824] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:45.307665 17693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: No bootstrap required, opened a new log
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:45.311774 17693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } }
I20260809 01:57:45.311992 17693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:45.312027 17693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a1b10fbe87d432fa3759c0f199c3306, State: Initialized, Role: FOLLOWER
I20260809 01:57:45.312503 17693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } }
I20260809 01:57:45.312656 17693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:45.312757 17693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:45.312887 17693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:45.313752 17693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } }
I20260809 01:57:45.314082 17693 leader_election.cc:302] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a1b10fbe87d432fa3759c0f199c3306; no voters:
I20260809 01:57:45.314414 17693 leader_election.cc:288] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:45.314527 17699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:45.314723 17699 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [term 1 LEADER]: Becoming Leader. State: Replica: 1a1b10fbe87d432fa3759c0f199c3306, State: Running, Role: LEADER
I20260809 01:57:45.315057 17699 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } }
I20260809 01:57:45.315696 17693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:45.315923 17697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:45.302541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49724 (local address 127.14.175.254:41679)
0809 01:57:45.303009 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:45.303028 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:45.303070 (+ 42us) server_negotiation.cc:407] Connection header received
0809 01:57:45.303732 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:45.303748 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:45.304048 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:45.304376 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:45.305168 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.306258 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.307166 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.307628 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.307796 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:45.310461 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:45.310466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:45.310478 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:45.310503 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:45.312397 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.312936 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.312940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.312944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.313109 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.313412 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.313416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.313418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.313823 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:45.314054 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:45.314378 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 01:57:45.314999 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":131,"threads_started":1}
I20260809 01:57:45.316190 17699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a1b10fbe87d432fa3759c0f199c3306. Latest consensus state: current_term: 1 leader_uuid: "1a1b10fbe87d432fa3759c0f199c3306" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } } }
I20260809 01:57:45.316303 17699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:45.316797 17701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a1b10fbe87d432fa3759c0f199c3306" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1b10fbe87d432fa3759c0f199c3306" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41679 } } }
I20260809 01:57:45.316962 17701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306 [sys.catalog]: This master's current role is: LEADER
W20260809 01:57:45.321115 17716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:45.321203 17716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:45.321276 17704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:45.322083 17704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:45.327008 17704 catalog_manager.cc:1347] Generated new cluster ID: 101fe6a9f0b3470a950553de0c6ea62d
I20260809 01:57:45.327075 17704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:45.335484 17704 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:45.336601 17704 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:45.345232 17704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a1b10fbe87d432fa3759c0f199c3306: Generated new TSK 0
I20260809 01:57:45.345876 17704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:45.373699 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:45.483182 17721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:45.483424 17721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:45.483467 17721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:45.487418 17721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:45.487468 17721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:45.487525 17721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:45.492636 17721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:45.493548 17721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:45.494467 17721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:45.504032 17730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.504041 17726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.504033 17727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:45.504364 17721 server_base.cc:1034] running on GCE node
I20260809 01:57:45.504741 17721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:45.505357 17721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:45.506549 17721 hybrid_clock.cc:648] HybridClock initialized: now 1786240665506535 us; error 36 us; skew 500 ppm
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:45.509310 17721 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:45.510216 17721 webserver.cc:460] Webserver started at http://127.14.175.193:43427/ using document root <none> and password file <none>
I20260809 01:57:45.510764 17721 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:45.510856 17721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:45.511142 17721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:45.513131 17721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "8af437bea4ec4f7c8298432e518a0cd1"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "0d36a9f0f9fb16f59c77ac38a55e7e18"
server_key_iv: "1a9bf807ba6460e62c4adf3f263a3a4f"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.513685 17721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "8af437bea4ec4f7c8298432e518a0cd1"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "0d36a9f0f9fb16f59c77ac38a55e7e18"
server_key_iv: "1a9bf807ba6460e62c4adf3f263a3a4f"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.517561 17721 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 01:57:45.520061 17737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.521210 17721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:45.521353 17721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "8af437bea4ec4f7c8298432e518a0cd1"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "0d36a9f0f9fb16f59c77ac38a55e7e18"
server_key_iv: "1a9bf807ba6460e62c4adf3f263a3a4f"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.521464 17721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:45.569160 17721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:45.572184 17721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:45.572400 17721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:45.573000 17721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:45.573807 17721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:45.573885 17721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.573956 17721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:45.574008 17721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.583103 17721 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:33679
I20260809 01:57:45.583161 17855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:33679 every 8 connection(s)
I20260809 01:57:45.584002 17721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:45.590551 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 17721
I20260809 01:57:45.590682 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:45.591003 15039 external_mini_cluster.cc:1428] Setting key 271c83dad3d13cdfb65d86128f745432
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:45.597795 17697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:45.585703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:43901 (local address 127.14.175.254:41679)
0809 01:57:45.585840 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:45.585845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:45.586648 (+ 803us) server_negotiation.cc:407] Connection header received
0809 01:57:45.587870 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:45.587872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:45.587920 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:45.587996 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:45.589085 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.589610 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.590821 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.591216 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.591333 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:45.593999 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:45.594005 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:45.594012 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:45.594044 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:45.595571 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.596207 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.596209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.596211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.596284 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.596673 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.596675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.596676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.596838 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:45.596920 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:45.597577 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 01:57:45.597678 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 01:57:45.599057 17859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:45.586048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41679 (local address 127.14.175.193:43901)
0809 01:57:45.586484 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:45.586538 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:45.587683 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:45.588156 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:45.588162 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:45.588498 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:45.588954 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:45.588967 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.589716 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.589718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:45.590632 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:45.590641 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.591388 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.591392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:45.591626 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:45.592313 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:45.592335 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:45.593829 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:45.595692 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:45.595702 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:45.595718 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:45.596102 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:45.596377 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:45.596383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:45.596388 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:45.596578 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:45.596956 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:45.596966 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:45.597301 (+ 335us) client_negotiation.cc:769] Sending connection context
0809 01:57:45.597538 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 01:57:45.597893 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":116,"threads_started":1}
I20260809 01:57:45.600311 17857 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41679
I20260809 01:57:45.600531 17857 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:45.600987 17857 heartbeater.cc:511] Master 127.14.175.254:41679 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:57:45.602515 17657 ts_manager.cc:194] Registered new tserver with Master: 8af437bea4ec4f7c8298432e518a0cd1 (127.14.175.193:33679)
I20260809 01:57:45.603776 17657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:43901
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:45.619493 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:45.729700 17862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:45.729990 17862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:45.730070 17862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:45.734066 17862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:45.734158 17862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:45.734251 17862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:45.739415 17862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:45.740414 17862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:45.741875 17862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:45.752470 17867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.752532 17870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.752504 17868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:45.752830 17862 server_base.cc:1034] running on GCE node
I20260809 01:57:45.753201 17862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:45.753834 17862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:45.755028 17862 hybrid_clock.cc:648] HybridClock initialized: now 1786240665754992 us; error 42 us; skew 500 ppm
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:45.757884 17862 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:45.758952 17862 webserver.cc:460] Webserver started at http://127.14.175.194:38637/ using document root <none> and password file <none>
I20260809 01:57:45.759510 17862 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:45.759570 17862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:45.759729 17862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:45.761657 17862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "c37ba299dc3444f7bf7b12c8d028d7e5"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "1d309918e96465ff7e17ca33e9e67cad"
server_key_iv: "7ab7872ea1c81dcdbb7cac3f9ff163f9"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.762202 17862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "c37ba299dc3444f7bf7b12c8d028d7e5"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "1d309918e96465ff7e17ca33e9e67cad"
server_key_iv: "7ab7872ea1c81dcdbb7cac3f9ff163f9"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.766053 17862 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 01:57:45.768496 17877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.769737 17862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:45.769891 17862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "c37ba299dc3444f7bf7b12c8d028d7e5"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "1d309918e96465ff7e17ca33e9e67cad"
server_key_iv: "7ab7872ea1c81dcdbb7cac3f9ff163f9"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.770004 17862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:45.806242 17862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:45.809844 17862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:45.810050 17862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:45.810657 17862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:45.811554 17862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:45.811626 17862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.811698 17862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:45.811750 17862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:45.821466 17862 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:41789
I20260809 01:57:45.821494 17995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:41789 every 8 connection(s)
I20260809 01:57:45.822537 17862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:45.825974 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 17862
I20260809 01:57:45.826089 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:45.826426 15039 external_mini_cluster.cc:1428] Setting key 371ab332c34e4fd5543de019c3cc5687
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:45.837800 17697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:45.824671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:45483 (local address 127.14.175.254:41679)
0809 01:57:45.824816 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:45.824828 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:45.826209 (+ 1381us) server_negotiation.cc:407] Connection header received
0809 01:57:45.827367 (+ 1158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:45.827371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:45.827422 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:45.827535 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:45.829051 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.829576 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.830843 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.831287 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.831414 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:45.834011 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:45.834014 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:45.834017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:45.834057 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:45.835601 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.836202 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.836204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.836205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.836279 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:45.836687 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:45.836689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:45.836690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:45.836853 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:45.836928 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:45.837586 (+ 658us) server_negotiation.cc:299] Negotiation successful
0809 01:57:45.837684 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 01:57:45.838662 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:45.825019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41679 (local address 127.14.175.194:45483)
0809 01:57:45.826045 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:45.826105 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:45.827156 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:45.827702 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:45.827708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:45.828176 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:45.828855 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:45.828876 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.829702 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.829709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:45.830710 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:45.830719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:45.831432 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:45.831435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:45.831571 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:45.832191 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:45.832212 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:45.833829 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:45.835719 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:45.835727 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:45.835744 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:45.836104 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:45.836372 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:45.836378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:45.836382 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:45.836594 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:45.836965 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:45.836972 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:45.837267 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 01:57:45.837536 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 01:57:45.837839 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"thread_start_us":586,"threads_started":1}
I20260809 01:57:45.839926 17996 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41679
I20260809 01:57:45.840127 17996 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:45.840562 17996 heartbeater.cc:511] Master 127.14.175.254:41679 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:57:45.841588 17657 ts_manager.cc:194] Registered new tserver with Master: c37ba299dc3444f7bf7b12c8d028d7e5 (127.14.175.194:41789)
I20260809 01:57:45.842154 17657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:45483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:45.857978 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:45.968107 18001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:45.968365 18001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:45.968410 18001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:45.972497 18001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:45.972556 18001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:45.972645 18001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:45.978024 18001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:45.979079 18001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:45.980091 18001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:45.989558 18008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.989569 18007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:45.989569 18010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:45.990049 18001 server_base.cc:1034] running on GCE node
I20260809 01:57:45.990481 18001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:45.991151 18001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:45.992328 18001 hybrid_clock.cc:648] HybridClock initialized: now 1786240665992298 us; error 47 us; skew 500 ppm
Aug 09 01:57:45 dist-test-slave-2w3w krb5kdc[17607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:45.995188 18001 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:45.996014 18001 webserver.cc:460] Webserver started at http://127.14.175.195:38989/ using document root <none> and password file <none>
I20260809 01:57:45.996568 18001 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:45.996660 18001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:45.996892 18001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:45.998891 18001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "45d95ba67d654b329b5b4a35f060d672"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "d9b0a9d9978161b720d1f6420ad55530"
server_key_iv: "932f9e9472011c59cc7842789e3e9775"
server_key_version: "encryptionkey@0"
I20260809 01:57:45.999517 18001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "45d95ba67d654b329b5b4a35f060d672"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "d9b0a9d9978161b720d1f6420ad55530"
server_key_iv: "932f9e9472011c59cc7842789e3e9775"
server_key_version: "encryptionkey@0"
I20260809 01:57:46.003145 18001 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:46.005587 18017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:46.006719 18001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:46.006865 18001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "45d95ba67d654b329b5b4a35f060d672"
format_stamp: "Formatted at 2026-08-09 01:57:45 on dist-test-slave-2w3w"
server_key: "d9b0a9d9978161b720d1f6420ad55530"
server_key_iv: "932f9e9472011c59cc7842789e3e9775"
server_key_version: "encryptionkey@0"
I20260809 01:57:46.007009 18001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:46.017462 18001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:46.020706 18001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:46.020918 18001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:46.021497 18001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:46.022324 18001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:46.022398 18001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:46.022470 18001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:46.022517 18001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:46.031418 18001 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:34079
I20260809 01:57:46.031450 18139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:34079 every 8 connection(s)
I20260809 01:57:46.032272 18001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:46.034198 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18001
I20260809 01:57:46.034327 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:46.034672 15039 external_mini_cluster.cc:1428] Setting key f39a83f3bdab4b9d0afbdc6820ff7f1a
Aug 09 01:57:46 dist-test-slave-2w3w krb5kdc[17607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240665, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:46.045837 17697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:46.033984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:59875 (local address 127.14.175.254:41679)
0809 01:57:46.034113 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:46.034117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:46.035393 (+ 1276us) server_negotiation.cc:407] Connection header received
0809 01:57:46.036752 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:46.036755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:46.036809 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:46.036901 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:46.038030 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:46.038554 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:46.039737 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:46.040031 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:46.040142 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:46.042711 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:46.042714 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:46.042716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:46.042738 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:46.044105 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:46.044583 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:46.044586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:46.044587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:46.044664 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:46.044961 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:46.044963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:46.044964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:46.045126 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:46.045201 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:46.045625 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 01:57:46.045719 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 01:57:46.046586 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:46.034441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41679 (local address 127.14.175.195:59875)
0809 01:57:46.035031 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:46.035088 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:46.036561 (+ 1473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:46.037112 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:46.037118 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:46.037455 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:46.037908 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:46.037921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:46.038662 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:46.038664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:46.039629 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:46.039638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:46.040219 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:46.040226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:46.040475 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:46.041154 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:46.041169 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:46.042564 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:46.044209 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:46.044213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:46.044223 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:46.044485 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:46.044746 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:46.044748 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:46.044750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:46.044873 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:46.045211 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:46.045216 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:46.045425 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 01:57:46.045573 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 01:57:46.045801 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":159,"threads_started":1}
I20260809 01:57:46.047823 18140 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41679
I20260809 01:57:46.048056 18140 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:46.048640 18140 heartbeater.cc:511] Master 127.14.175.254:41679 requested a full tablet report, sending...
I20260809 01:57:46.049600 17657 ts_manager.cc:194] Registered new tserver with Master: 45d95ba67d654b329b5b4a35f060d672 (127.14.175.195:34079)
I20260809 01:57:46.050097 17657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:59875
I20260809 01:57:46.060211 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 01:57:46.074951 17697 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:46.073455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.14.175.254:41679)
0809 01:57:46.073626 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:46.073631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:46.073864 (+ 233us) server_negotiation.cc:407] Connection header received
0809 01:57:46.073983 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:46.073987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:46.074048 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:46.074118 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:46.074816 (+ 698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49732: BlockingRecv error: recv got EOF from 127.0.0.1:49732 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:57:46.076550 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 17721
I20260809 01:57:46.084298 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 17862
I20260809 01:57:46.091622 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18001
I20260809 01:57:46.098414 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 17620
2026-08-09T01:57:46Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2199 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:46 dist-test-slave-2w3w krb5kdc[18153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:46 dist-test-slave-2w3w krb5kdc[18153](info): set up 2 sockets
Aug 09 01:57:46 dist-test-slave-2w3w krb5kdc[18153](info): commencing operation
krb5kdc: starting...
W20260809 01:57:47.184068 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:47.305543 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:45069
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:40395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:45069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:47.413715 18166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:47.413966 18166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:47.414005 18166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:47.417971 18166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:47.418023 18166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:47.418041 18166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:47.418057 18166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:47.418071 18166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:47.423296 18166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:45069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:45069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:47.424283 18166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:47.425288 18166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:47.433667 18173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:47.433678 18175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:47.433681 18172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:47.433713 18166 server_base.cc:1034] running on GCE node
I20260809 01:57:47.434473 18166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:47.435559 18166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:47.436746 18166 hybrid_clock.cc:648] HybridClock initialized: now 1786240667436720 us; error 38 us; skew 500 ppm
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240667, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:47.442719 18166 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:47.443677 18166 webserver.cc:460] Webserver started at http://127.14.175.254:34275/ using document root <none> and password file <none>
I20260809 01:57:47.444222 18166 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:47.444310 18166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:47.444535 18166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:47.446494 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "562502135d6d4787852fe2aef25ee45b"
format_stamp: "Formatted at 2026-08-09 01:57:47 on dist-test-slave-2w3w"
server_key: "360d4ea1193ace8e106607712e75e340"
server_key_iv: "a0eca46edb99d7805d8816c1b8e0d7d5"
server_key_version: "encryptionkey@0"
I20260809 01:57:47.447111 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "562502135d6d4787852fe2aef25ee45b"
format_stamp: "Formatted at 2026-08-09 01:57:47 on dist-test-slave-2w3w"
server_key: "360d4ea1193ace8e106607712e75e340"
server_key_iv: "a0eca46edb99d7805d8816c1b8e0d7d5"
server_key_version: "encryptionkey@0"
I20260809 01:57:47.450515 18166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:47.452737 18182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:47.453877 18166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:47.454030 18166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "562502135d6d4787852fe2aef25ee45b"
format_stamp: "Formatted at 2026-08-09 01:57:47 on dist-test-slave-2w3w"
server_key: "360d4ea1193ace8e106607712e75e340"
server_key_iv: "a0eca46edb99d7805d8816c1b8e0d7d5"
server_key_version: "encryptionkey@0"
I20260809 01:57:47.454147 18166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:47.467075 18166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:47.469712 18166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:47.469911 18166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:47.476847 18166 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:45069
I20260809 01:57:47.477234 18236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:45069 every 8 connection(s)
I20260809 01:57:47.477785 18166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:47.480535 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:47.481639 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18166
I20260809 01:57:47.481786 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:47.482060 15039 external_mini_cluster.cc:1428] Setting key 1c27648b3310e4a43a4c2d5b045fc96a
I20260809 01:57:47.486704 18237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: Bootstrap starting.
I20260809 01:57:47.489271 18237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:47.490181 18237 log.cc:824] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: Log is configured to *not* fsync() on all Append() calls
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:47.492275 18237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: No bootstrap required, opened a new log
I20260809 01:57:47.495712 18237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } }
I20260809 01:57:47.495851 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:47.483351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.14.175.254:45069)
0809 01:57:47.483725 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:47.483739 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:47.483772 (+ 33us) server_negotiation.cc:407] Connection header received
0809 01:57:47.484379 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:47.484394 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:47.484690 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:47.484956 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:47.485903 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:47.486887 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:47.488070 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:47.488498 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:47.488611 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:47.491408 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:47.491413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:47.491424 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:47.491448 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:47.493127 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:47.493580 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:47.493585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:47.493589 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:47.493692 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:47.493981 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:47.493985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:47.493986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:47.494365 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:47.494565 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:47.494870 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 01:57:47.495164 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":113,"threads_started":1}
I20260809 01:57:47.495960 18237 raft_consensus.cc:374] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:47.496023 18237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 562502135d6d4787852fe2aef25ee45b, State: Initialized, Role: FOLLOWER
I20260809 01:57:47.496524 18237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } }
I20260809 01:57:47.496680 18237 raft_consensus.cc:388] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:47.496742 18237 raft_consensus.cc:482] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:47.496833 18237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:47.497933 18237 raft_consensus.cc:504] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } }
I20260809 01:57:47.498322 18237 leader_election.cc:302] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 562502135d6d4787852fe2aef25ee45b; no voters:
I20260809 01:57:47.498692 18237 leader_election.cc:288] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:47.498822 18242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:47.498991 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 01:57:47.499070 18242 raft_consensus.cc:686] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [term 1 LEADER]: Becoming Leader. State: Replica: 562502135d6d4787852fe2aef25ee45b, State: Running, Role: LEADER
I20260809 01:57:47.499352 18242 consensus_queue.cc:237] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } }
I20260809 01:57:47.499890 18237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:47.500485 18242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 562502135d6d4787852fe2aef25ee45b. Latest consensus state: current_term: 1 leader_uuid: "562502135d6d4787852fe2aef25ee45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } } }
I20260809 01:57:47.500603 18242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:47.500914 18243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "562502135d6d4787852fe2aef25ee45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "562502135d6d4787852fe2aef25ee45b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45069 } } }
I20260809 01:57:47.501020 18243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b [sys.catalog]: This master's current role is: LEADER
W20260809 01:57:47.504963 18260 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:47.505046 18260 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:47.505118 18249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:47.506152 18249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:47.511340 18249 catalog_manager.cc:1347] Generated new cluster ID: 183cdb323a244670869f2089de57df78
I20260809 01:57:47.511443 18249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:47.521124 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:47.515478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57052 (local address 127.14.175.254:45069)
0809 01:57:47.515591 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:47.515595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:47.515878 (+ 283us) server_negotiation.cc:407] Connection header received
0809 01:57:47.516017 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:47.516020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:47.516068 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:47.516152 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:47.516776 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:47.517563 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:47.518761 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:47.519147 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:47.519238 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:47.520134 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:47.520138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:47.520141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:47.520654 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:47.520685 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:47.520704 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:47.520791 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:47.520922 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 01:57:47.520979 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 01:57:47.542095 18249 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:47.543077 18249 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:47.546794 18249 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 562502135d6d4787852fe2aef25ee45b: Generated new TSK 0
I20260809 01:57:47.547643 18249 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:57:47.561906 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18166
2026-08-09T01:57:47Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1462 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18273](info): set up 2 sockets
Aug 09 01:57:47 dist-test-slave-2w3w krb5kdc[18273](info): commencing operation
krb5kdc: starting...
W20260809 01:57:48.640590 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:48 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:48.765627 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33841
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:32773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:33841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:48.872668 18287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:48.872912 18287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:48.872956 18287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:48.876853 18287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:48.876897 18287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:48.876916 18287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:48.876931 18287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:48.876946 18287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:48.881767 18287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:33841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:48.882632 18287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:48.883617 18287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:48.891834 18292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:48.891829 18295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:48.891825 18293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:48.892050 18287 server_base.cc:1034] running on GCE node
I20260809 01:57:48.892772 18287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:48.893812 18287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:48.895032 18287 hybrid_clock.cc:648] HybridClock initialized: now 1786240668895003 us; error 44 us; skew 500 ppm
Aug 09 01:57:48 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240668, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:48.897663 18287 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:48.898519 18287 webserver.cc:460] Webserver started at http://127.14.175.254:38707/ using document root <none> and password file <none>
I20260809 01:57:48.899108 18287 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:48.899202 18287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:48.899431 18287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:48.901376 18287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "e4096c2b90c043a2931c6dc27e459415"
format_stamp: "Formatted at 2026-08-09 01:57:48 on dist-test-slave-2w3w"
server_key: "d42f6035c7f3b048b7cece7aded9dd55"
server_key_iv: "31a85aff34d5a5257a59f9ebbdc80337"
server_key_version: "encryptionkey@0"
I20260809 01:57:48.901980 18287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "e4096c2b90c043a2931c6dc27e459415"
format_stamp: "Formatted at 2026-08-09 01:57:48 on dist-test-slave-2w3w"
server_key: "d42f6035c7f3b048b7cece7aded9dd55"
server_key_iv: "31a85aff34d5a5257a59f9ebbdc80337"
server_key_version: "encryptionkey@0"
I20260809 01:57:48.905602 18287 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 01:57:48.907888 18302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:48.909052 18287 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:48.909198 18287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "e4096c2b90c043a2931c6dc27e459415"
format_stamp: "Formatted at 2026-08-09 01:57:48 on dist-test-slave-2w3w"
server_key: "d42f6035c7f3b048b7cece7aded9dd55"
server_key_iv: "31a85aff34d5a5257a59f9ebbdc80337"
server_key_version: "encryptionkey@0"
I20260809 01:57:48.909307 18287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:48.925885 18287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:48.929159 18287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:48.929363 18287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:48.936599 18287 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:33841
I20260809 01:57:48.936897 18358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:33841 every 8 connection(s)
I20260809 01:57:48.937561 18287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:48.940246 18359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:48.941912 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18287
I20260809 01:57:48.942047 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:48.942335 15039 external_mini_cluster.cc:1428] Setting key fe054a1fedd99a629de4e450f4f3f77f
I20260809 01:57:48.946765 18359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415: Bootstrap starting.
I20260809 01:57:48.949405 18359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:48.950343 18359 log.cc:824] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415: Log is configured to *not* fsync() on all Append() calls
Aug 09 01:57:48 dist-test-slave-2w3w krb5kdc[18273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:48.952353 18359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415: No bootstrap required, opened a new log
I20260809 01:57:48.955751 18359 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } }
I20260809 01:57:48.956045 18359 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:48.956142 18359 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4096c2b90c043a2931c6dc27e459415, State: Initialized, Role: FOLLOWER
I20260809 01:57:48.956614 18359 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } }
I20260809 01:57:48.956763 18359 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:48.956832 18359 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:48.956875 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:48.943723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.14.175.254:33841)
0809 01:57:48.944153 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:48.944169 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:48.944204 (+ 35us) server_negotiation.cc:407] Connection header received
0809 01:57:48.944796 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:48.944811 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:48.945124 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:48.945385 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:48.946322 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:48.947407 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:48.948626 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:48.949079 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:48.949200 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:48.952168 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:48.952173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:48.952185 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:48.952211 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:48.953891 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:48.954356 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:48.954361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:48.954365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:48.954477 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:48.954778 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:48.954782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:48.954784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:48.955228 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:48.955442 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:48.955731 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 01:57:48.956021 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":137,"threads_started":1}
I20260809 01:57:48.956931 18359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:48.958035 18359 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } }
I20260809 01:57:48.958359 18359 leader_election.cc:302] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4096c2b90c043a2931c6dc27e459415; no voters:
I20260809 01:57:48.958688 18359 leader_election.cc:288] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:48.958796 18365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:48.959029 18365 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [term 1 LEADER]: Becoming Leader. State: Replica: e4096c2b90c043a2931c6dc27e459415, State: Running, Role: LEADER
I20260809 01:57:48.959372 18365 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } }
I20260809 01:57:48.959904 18359 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:48.960991 18367 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4096c2b90c043a2931c6dc27e459415" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } } }
I20260809 01:57:48.961118 18367 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:48.961506 18375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:48.961444 18366 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4096c2b90c043a2931c6dc27e459415. Latest consensus state: current_term: 1 leader_uuid: "e4096c2b90c043a2931c6dc27e459415" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4096c2b90c043a2931c6dc27e459415" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33841 } } }
I20260809 01:57:48.961647 18366 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:48.964764 18375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:48.970192 18375 catalog_manager.cc:1347] Generated new cluster ID: d1db91cefce74a3980231ecb8dc5038d
I20260809 01:57:48.970261 18375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:48.988511 18375 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:48.989444 18375 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:48.995223 18375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4096c2b90c043a2931c6dc27e459415: Generated new TSK 0
I20260809 01:57:48.995940 18375 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:49.025454 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:32773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:49.137157 18388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:49.137445 18388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:49.137526 18388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:49.141572 18388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:49.141654 18388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:49.141742 18388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:49.146781 18388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:49.147837 18388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:49.148859 18388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:49.158268 18395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:49.158277 18397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:49.158277 18394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:49.158329 18388 server_base.cc:1034] running on GCE node
I20260809 01:57:49.158944 18388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:49.159605 18388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:49.160787 18388 hybrid_clock.cc:648] HybridClock initialized: now 1786240669160762 us; error 45 us; skew 500 ppm
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:49.163555 18388 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:49.164399 18388 webserver.cc:460] Webserver started at http://127.14.175.193:45225/ using document root <none> and password file <none>
I20260809 01:57:49.164939 18388 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:49.165037 18388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:49.165261 18388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:49.167302 18388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "9d55e81df8054d6eab73f653c032d318"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "23d5c03ce459e800e7e697d75e8931f6"
server_key_iv: "e6251b9ce9eb5e4e9be0e17eb3bf54fe"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.167858 18388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "9d55e81df8054d6eab73f653c032d318"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "23d5c03ce459e800e7e697d75e8931f6"
server_key_iv: "e6251b9ce9eb5e4e9be0e17eb3bf54fe"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.171367 18388 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 01:57:49.173617 18405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.174785 18388 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:49.174918 18388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "9d55e81df8054d6eab73f653c032d318"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "23d5c03ce459e800e7e697d75e8931f6"
server_key_iv: "e6251b9ce9eb5e4e9be0e17eb3bf54fe"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.175078 18388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:49.196691 18388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:49.199501 18388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:49.199710 18388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:49.200301 18388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:49.201119 18388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:49.201192 18388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.201265 18388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:49.201308 18388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.210448 18388 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:36121
I20260809 01:57:49.210537 18524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:36121 every 8 connection(s)
I20260809 01:57:49.211426 18388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:49.211766 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18388
I20260809 01:57:49.211905 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:49.212249 15039 external_mini_cluster.cc:1428] Setting key 09ffea16ce73c22acdccbdfd74a31bdc
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:57:49.227097 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.213371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:34911 (local address 127.14.175.254:33841)
0809 01:57:49.213500 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:49.213504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:49.214340 (+ 836us) server_negotiation.cc:407] Connection header received
0809 01:57:49.216532 (+ 2192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:49.216535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:49.216604 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:49.216702 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:49.217872 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.218755 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.220047 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.220507 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.220643 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.223427 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:49.223430 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:49.223432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:49.223454 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:49.224854 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.225319 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.225321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.225322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.225396 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.225748 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.225751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.225752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.225922 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:49.225996 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:49.226661 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 01:57:49.226810 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 01:57:49.227794 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.213672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33841 (local address 127.14.175.193:34911)
0809 01:57:49.214172 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:49.214231 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:49.216310 (+ 2079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:49.216908 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:49.216914 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:49.217261 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:49.217721 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.217733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.218885 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.218887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.219913 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.219923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.220656 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.220658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.220793 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.221382 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:49.221398 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:49.223254 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:49.224961 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.224965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.224975 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.225224 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.225471 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.225473 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.225475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.225655 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.226010 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:49.226015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:49.226367 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 01:57:49.226587 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 01:57:49.226856 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":116,"threads_started":1}
I20260809 01:57:49.229004 18525 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33841
I20260809 01:57:49.229243 18525 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:49.229702 18525 heartbeater.cc:511] Master 127.14.175.254:33841 requested a full tablet report, sending...
I20260809 01:57:49.231186 18320 ts_manager.cc:194] Registered new tserver with Master: 9d55e81df8054d6eab73f653c032d318 (127.14.175.193:36121)
I20260809 01:57:49.232323 18320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:34911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:49.242271 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:32773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:49.349752 18532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:49.350030 18532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:49.350111 18532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:49.354087 18532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:49.354171 18532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:49.354259 18532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:49.359362 18532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:49.360332 18532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:49.361362 18532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:49.370597 18539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:49.370609 18538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:49.370609 18541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:49.370827 18532 server_base.cc:1034] running on GCE node
I20260809 01:57:49.371268 18532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:49.371840 18532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:49.372999 18532 hybrid_clock.cc:648] HybridClock initialized: now 1786240669372971 us; error 35 us; skew 500 ppm
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:49.375759 18532 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:49.376540 18532 webserver.cc:460] Webserver started at http://127.14.175.194:45755/ using document root <none> and password file <none>
I20260809 01:57:49.377014 18532 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:49.377070 18532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:49.377220 18532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:49.379309 18532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "9842a706ead546bfafbf50cd41f413d5"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "99c6077167170f2b72e49f2bde0aac9f"
server_key_iv: "e8fa4e6f8824e9096aea286a9d9dd9f0"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.379789 18532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "9842a706ead546bfafbf50cd41f413d5"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "99c6077167170f2b72e49f2bde0aac9f"
server_key_iv: "e8fa4e6f8824e9096aea286a9d9dd9f0"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.383128 18532 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 01:57:49.385243 18549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.386355 18532 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:49.386487 18532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "9842a706ead546bfafbf50cd41f413d5"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "99c6077167170f2b72e49f2bde0aac9f"
server_key_iv: "e8fa4e6f8824e9096aea286a9d9dd9f0"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.386596 18532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:49.401141 18532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:49.404282 18532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:49.404475 18532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:49.405025 18532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:49.405787 18532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:49.405857 18532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.405926 18532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:49.405982 18532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.415154 18532 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:35665
I20260809 01:57:49.415198 18665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:35665 every 8 connection(s)
I20260809 01:57:49.415972 18532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:49.418190 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18532
I20260809 01:57:49.418329 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:49.418676 15039 external_mini_cluster.cc:1428] Setting key b3ec2d5b4d3d250158ceb501f42086b5
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:49.430039 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.417590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:40171 (local address 127.14.175.254:33841)
0809 01:57:49.417717 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:49.417720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:49.418562 (+ 842us) server_negotiation.cc:407] Connection header received
0809 01:57:49.420185 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:49.420190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:49.420238 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:49.420316 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:49.421863 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.422548 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.423738 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.423995 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.424112 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.426471 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:49.426474 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:49.426476 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:49.426499 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:49.427947 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.428461 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.428466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.428468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.428549 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.428938 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.428943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.428945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.429123 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:49.429234 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:49.429739 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 01:57:49.429860 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 01:57:49.430819 18668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.417871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33841 (local address 127.14.175.194:40171)
0809 01:57:49.418389 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:49.418447 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:49.419954 (+ 1507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:49.420510 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:49.420519 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:49.421041 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:49.421711 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.421733 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.422683 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.422686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.423617 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.423626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.424150 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.424154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.424325 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.424888 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:49.424904 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:49.426308 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:49.428090 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.428095 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.428108 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.428359 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.428655 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.428659 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.428661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.428840 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.429233 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:49.429240 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:49.429464 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 01:57:49.429674 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 01:57:49.429975 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:57:49.432024 18666 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33841
I20260809 01:57:49.432273 18666 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:49.432828 18666 heartbeater.cc:511] Master 127.14.175.254:33841 requested a full tablet report, sending...
I20260809 01:57:49.433967 18320 ts_manager.cc:194] Registered new tserver with Master: 9842a706ead546bfafbf50cd41f413d5 (127.14.175.194:35665)
I20260809 01:57:49.434540 18320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:40171
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:49.448033 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:32773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:49.562832 18671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:49.563109 18671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:49.563154 18671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:49.567351 18671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:49.567399 18671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:49.567481 18671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:49.572546 18671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:49.573465 18671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:49.574404 18671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:49.583722 18677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:49.583851 18671 server_base.cc:1034] running on GCE node
W20260809 01:57:49.583752 18680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:49.584029 18678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:49.584429 18671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:49.585006 18671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:49.586195 18671 hybrid_clock.cc:648] HybridClock initialized: now 1786240669586182 us; error 25 us; skew 500 ppm
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:49.589115 18671 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:49.590261 18671 webserver.cc:460] Webserver started at http://127.14.175.195:41219/ using document root <none> and password file <none>
I20260809 01:57:49.590893 18671 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:49.590982 18671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:49.591192 18671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:49.593633 18671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "688e96e57b6d43f8a91b9e4dfab87bfa"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "9a45a6c872a7435cbb1f75ae0e7263a0"
server_key_iv: "c575b7bed3142e67d969e1ea1b2c4da5"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.594334 18671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "688e96e57b6d43f8a91b9e4dfab87bfa"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "9a45a6c872a7435cbb1f75ae0e7263a0"
server_key_iv: "c575b7bed3142e67d969e1ea1b2c4da5"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.598694 18671 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 01:57:49.601394 18688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.602646 18671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 01:57:49.602743 18671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "688e96e57b6d43f8a91b9e4dfab87bfa"
format_stamp: "Formatted at 2026-08-09 01:57:49 on dist-test-slave-2w3w"
server_key: "9a45a6c872a7435cbb1f75ae0e7263a0"
server_key_iv: "c575b7bed3142e67d969e1ea1b2c4da5"
server_key_version: "encryptionkey@0"
I20260809 01:57:49.602815 18671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:49.621762 18671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:49.624553 18671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:49.624734 18671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:49.625257 18671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:49.625998 18671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:49.626044 18671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.626080 18671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:49.626094 18671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:49.635145 18671 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:45001
I20260809 01:57:49.635174 18807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:45001 every 8 connection(s)
I20260809 01:57:49.635988 18671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:49.644770 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18671
I20260809 01:57:49.644898 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:49.645183 15039 external_mini_cluster.cc:1428] Setting key b06f8ce2588d697691355f842458498a
I20260809 01:57:49.648782 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.637616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:56773 (local address 127.14.175.254:33841)
0809 01:57:49.637745 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:49.637749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:49.638531 (+ 782us) server_negotiation.cc:407] Connection header received
0809 01:57:49.639820 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:49.639823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:49.639868 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:49.639945 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:49.640992 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.641500 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.642597 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.642801 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.642873 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.645308 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:49.645311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:49.645314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:49.645340 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:49.646882 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.647509 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.647511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.647513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.647585 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.647876 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.647878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.647880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.648073 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:49.648147 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:49.648572 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 01:57:49.648661 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:57:49.649530 18810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.637963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33841 (local address 127.14.175.195:56773)
0809 01:57:49.638382 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:49.638421 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:49.639639 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:49.640101 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:49.640107 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:49.640444 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:49.640870 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.640881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.641602 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.641604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.642481 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:49.642489 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.642918 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.642921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:49.643090 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.643668 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:49.643683 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:49.645148 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:49.647023 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.647029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.647041 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.647414 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.647664 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:49.647666 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:49.647667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:49.647789 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:49.648158 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:49.648162 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:49.648374 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 01:57:49.648510 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 01:57:49.648743 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":110,"threads_started":1}
I20260809 01:57:49.650585 18808 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33841
I20260809 01:57:49.650801 18808 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:49.651292 18808 heartbeater.cc:511] Master 127.14.175.254:33841 requested a full tablet report, sending...
I20260809 01:57:49.652261 18320 ts_manager.cc:194] Registered new tserver with Master: 688e96e57b6d43f8a91b9e4dfab87bfa (127.14.175.195:45001)
I20260809 01:57:49.652818 18320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:56773
I20260809 01:57:49.658846 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240669, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:49.685936 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:49.677011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50534 (local address 127.14.175.254:33841)
0809 01:57:49.677200 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:49.677205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:49.677346 (+ 141us) server_negotiation.cc:407] Connection header received
0809 01:57:49.677514 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:49.677517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:49.677569 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:49.677655 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:49.678414 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.679085 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.680031 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:49.680267 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:49.680377 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:49.682749 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:49.682753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:49.682756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:49.682792 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:49.684196 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.684634 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.684639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.684641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.684724 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:49.685012 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:49.685016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:49.685017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:49.685245 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:49.685394 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:49.685631 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 01:57:49.685749 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 01:57:49.686338 18320 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50534
I20260809 01:57:49.687247 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18388
I20260809 01:57:49.694725 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18532
I20260809 01:57:49.701439 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18671
I20260809 01:57:49.709733 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18287
2026-08-09T01:57:49Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2148 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18821](info): set up 2 sockets
Aug 09 01:57:49 dist-test-slave-2w3w krb5kdc[18821](info): commencing operation
krb5kdc: starting...
W20260809 01:57:50.784468 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:50 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:50.911782 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34609
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:34609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:51.021019 18835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:51.021332 18835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:51.021405 18835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:51.025499 18835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:51.025609 18835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:51.025648 18835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:51.025705 18835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:51.025743 18835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:51.032222 18835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:34609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:51.033265 18835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:51.034271 18835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:51.042734 18844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.042734 18840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.042758 18841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.043015 18835 server_base.cc:1034] running on GCE node
I20260809 01:57:51.043661 18835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:51.044855 18835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:51.046051 18835 hybrid_clock.cc:648] HybridClock initialized: now 1786240671046028 us; error 43 us; skew 500 ppm
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:51.049340 18835 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:51.050479 18835 webserver.cc:460] Webserver started at http://127.14.175.254:37735/ using document root <none> and password file <none>
I20260809 01:57:51.051182 18835 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:51.051278 18835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:51.051491 18835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:51.054025 18835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "ef18140749b24dd0841c3d0d98afd4f5"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "71c98c0b9df8ae8efb1ded94e3fbabcc"
server_key_iv: "ca233dbb22317eaca8a558bd8eeb4cf0"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.054684 18835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "ef18140749b24dd0841c3d0d98afd4f5"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "71c98c0b9df8ae8efb1ded94e3fbabcc"
server_key_iv: "ca233dbb22317eaca8a558bd8eeb4cf0"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.058346 18835 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:57:51.060633 18851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.061784 18835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 01:57:51.061950 18835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "ef18140749b24dd0841c3d0d98afd4f5"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "71c98c0b9df8ae8efb1ded94e3fbabcc"
server_key_iv: "ca233dbb22317eaca8a558bd8eeb4cf0"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.062059 18835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:51.079289 18835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:51.081885 18835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:51.082087 18835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:51.089560 18835 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:34609
I20260809 01:57:51.089570 18905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:34609 every 8 connection(s)
I20260809 01:57:51.090451 18835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:51.093146 18906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:51.098435 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18835
I20260809 01:57:51.098475 18906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: Bootstrap starting.
I20260809 01:57:51.098591 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:51.098867 15039 external_mini_cluster.cc:1428] Setting key 5be3a621b7d284a4d137c7bec9d181e6
I20260809 01:57:51.100927 18906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:51.101666 18906 log.cc:824] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:51.103752 18906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: No bootstrap required, opened a new log
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:51.108296 18906 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } }
I20260809 01:57:51.108528 18906 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:51.108605 18906 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef18140749b24dd0841c3d0d98afd4f5, State: Initialized, Role: FOLLOWER
I20260809 01:57:51.109025 18906 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } }
I20260809 01:57:51.109146 18906 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:51.109232 18906 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:51.109370 18906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:51.110214 18906 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } }
I20260809 01:57:51.110549 18906 leader_election.cc:302] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef18140749b24dd0841c3d0d98afd4f5; no voters:
I20260809 01:57:51.110903 18906 leader_election.cc:288] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:51.110942 18911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:51.111182 18911 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [term 1 LEADER]: Becoming Leader. State: Replica: ef18140749b24dd0841c3d0d98afd4f5, State: Running, Role: LEADER
I20260809 01:57:51.111466 18911 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } }
I20260809 01:57:51.112157 18906 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:51.112619 18914 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef18140749b24dd0841c3d0d98afd4f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } } }
I20260809 01:57:51.112756 18914 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:51.113426 18912 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef18140749b24dd0841c3d0d98afd4f5. Latest consensus state: current_term: 1 leader_uuid: "ef18140749b24dd0841c3d0d98afd4f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef18140749b24dd0841c3d0d98afd4f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34609 } } }
I20260809 01:57:51.113524 18912 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:51.114310 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.100262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51978 (local address 127.14.175.254:34609)
0809 01:57:51.100660 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.100676 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.100709 (+ 33us) server_negotiation.cc:407] Connection header received
0809 01:57:51.101376 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.101396 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.101727 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.102062 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.102910 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.103979 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.105168 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.105620 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.105745 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.108626 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.108634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.108652 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.108706 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.110745 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.111343 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.111351 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.111356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.111492 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.111820 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.111823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.111825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.112261 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.112425 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.112932 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.113274 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":122,"threads_started":1}
W20260809 01:57:51.117377 18928 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:51.117465 18928 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:51.117550 18917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:51.118470 18917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:51.124074 18917 catalog_manager.cc:1347] Generated new cluster ID: ff72552e542a4a9ba985d8f1cd083adf
I20260809 01:57:51.124156 18917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:51.134639 18917 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:51.136026 18917 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:51.146616 18917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef18140749b24dd0841c3d0d98afd4f5: Generated new TSK 0
I20260809 01:57:51.147380 18917 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:51.185500 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:51.326200 18935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:51.326465 18935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:51.326510 18935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:51.330461 18935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:51.330514 18935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:51.330572 18935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:51.335804 18935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:51.336843 18935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:51.338099 18935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:51.347837 18940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.348037 18935 server_base.cc:1034] running on GCE node
W20260809 01:57:51.347872 18944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.347837 18942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.348541 18935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:51.349165 18935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:51.350355 18935 hybrid_clock.cc:648] HybridClock initialized: now 1786240671350335 us; error 34 us; skew 500 ppm
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:51.353272 18935 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:51.354138 18935 webserver.cc:460] Webserver started at http://127.14.175.193:36257/ using document root <none> and password file <none>
I20260809 01:57:51.354689 18935 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:51.354791 18935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:51.355078 18935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:51.357056 18935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "66cdcc3fe7554ce4b4de61e59b9f1239"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "0b84525da311839c8b6d833a3d9166ef"
server_key_iv: "1fdfe9caf5ab36fe78196d5aed5c1c6c"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.357635 18935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "66cdcc3fe7554ce4b4de61e59b9f1239"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "0b84525da311839c8b6d833a3d9166ef"
server_key_iv: "1fdfe9caf5ab36fe78196d5aed5c1c6c"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.361243 18935 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:51.363696 18951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.364879 18935 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:51.365018 18935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "66cdcc3fe7554ce4b4de61e59b9f1239"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "0b84525da311839c8b6d833a3d9166ef"
server_key_iv: "1fdfe9caf5ab36fe78196d5aed5c1c6c"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.365126 18935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:51.383266 18935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:51.386337 18935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:51.386541 18935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:51.387106 18935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:51.387930 18935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:51.388005 18935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.388063 18935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:51.388113 18935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.396950 18935 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:40239
I20260809 01:57:51.396986 19076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:40239 every 8 connection(s)
I20260809 01:57:51.397775 18935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:51.403270 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 18935
I20260809 01:57:51.403404 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:51.403700 15039 external_mini_cluster.cc:1428] Setting key 21ae7877893ba9b6a147a91017bb4cc5
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:51.412070 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.399477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:40763 (local address 127.14.175.254:34609)
0809 01:57:51.399631 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.399637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.400456 (+ 819us) server_negotiation.cc:407] Connection header received
0809 01:57:51.401864 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.401867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.401914 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.401999 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.403124 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.403966 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.405166 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.405397 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.405474 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.408527 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.408531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.408534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.408567 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.409983 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.410514 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.410520 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.410524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.410608 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.410976 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.410983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.410985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.411174 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.411286 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.411760 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.411889 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 01:57:51.412889 19079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.399851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34609 (local address 127.14.175.193:40763)
0809 01:57:51.400300 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:51.400349 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:51.401634 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:51.402161 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:51.402167 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:51.402490 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:51.402923 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.402935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.404127 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.404137 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.405001 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.405011 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.405556 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.405563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.405784 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.406382 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:51.406408 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:51.408355 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:51.410125 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.410131 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.410144 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.410403 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.410703 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.410708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.410709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.410858 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.411285 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:51.411291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:51.411530 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 01:57:51.411717 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 01:57:51.412023 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":139,"threads_started":1}
I20260809 01:57:51.414072 19077 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34609
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:57:51.414324 19077 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:51.414809 19077 heartbeater.cc:511] Master 127.14.175.254:34609 requested a full tablet report, sending...
I20260809 01:57:51.416456 18868 ts_manager.cc:194] Registered new tserver with Master: 66cdcc3fe7554ce4b4de61e59b9f1239 (127.14.175.193:40239)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:57:51.417706 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:40763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:51.431782 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:51.539731 19082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:51.539971 19082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:51.540011 19082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:51.544004 19082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:51.544051 19082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:51.544154 19082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:51.549191 19082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:51.550128 19082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:51.551107 19082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:51.560395 19093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.560352 19090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.560586 19088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.560678 19082 server_base.cc:1034] running on GCE node
I20260809 01:57:51.561160 19082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:51.561774 19082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:51.562930 19082 hybrid_clock.cc:648] HybridClock initialized: now 1786240671562903 us; error 38 us; skew 500 ppm
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:51.565671 19082 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:51.566519 19082 webserver.cc:460] Webserver started at http://127.14.175.194:35489/ using document root <none> and password file <none>
I20260809 01:57:51.567056 19082 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:51.567121 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:51.567273 19082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:51.569310 19082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "7945686bc30642cc874099378e85b633"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "97a8bed0a036d530e09a50c4d3af3128"
server_key_iv: "c725cdd8a5e1248d6e2f43b5d4c622d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.569811 19082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "7945686bc30642cc874099378e85b633"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "97a8bed0a036d530e09a50c4d3af3128"
server_key_iv: "c725cdd8a5e1248d6e2f43b5d4c622d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.573287 19082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:51.575538 19101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.576640 19082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:51.576731 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "7945686bc30642cc874099378e85b633"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "97a8bed0a036d530e09a50c4d3af3128"
server_key_iv: "c725cdd8a5e1248d6e2f43b5d4c622d6"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.576809 19082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:51.588634 19082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:51.591234 19082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:51.591370 19082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:51.591821 19082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:51.592535 19082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:51.592579 19082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.592615 19082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:51.592639 19082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.601516 19082 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:37049
I20260809 01:57:51.601559 19222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:37049 every 8 connection(s)
I20260809 01:57:51.602294 19082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:51.608117 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19082
I20260809 01:57:51.608251 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:51.608532 15039 external_mini_cluster.cc:1428] Setting key bd8294fa8a1cff1acab07aeef9851b02
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:51.616958 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.603967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53839 (local address 127.14.175.254:34609)
0809 01:57:51.604107 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.604111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.604909 (+ 798us) server_negotiation.cc:407] Connection header received
0809 01:57:51.606303 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.606314 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.606373 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.606478 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.607646 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.608198 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.609494 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.609742 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.609845 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.612852 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.612856 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.612858 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.612918 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.614597 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.615299 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.615302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.615303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.615380 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.615769 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.615771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.615772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.615977 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.616114 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.616740 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.616835 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 01:57:51.618083 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.604301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34609 (local address 127.14.175.194:53839)
0809 01:57:51.604738 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:51.604778 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:51.606097 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:51.606652 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:51.606658 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:51.607068 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:51.607503 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.607515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.608334 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.608340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.609373 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.609382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.609920 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.609924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.610149 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.610706 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:51.610730 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:51.612673 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:51.614719 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.614728 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.614745 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.615198 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.615477 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.615482 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.615488 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.615666 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.616138 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:51.616147 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:51.616467 (+ 320us) client_negotiation.cc:769] Sending connection context
0809 01:57:51.616688 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 01:57:51.617065 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":107,"threads_started":1}
I20260809 01:57:51.619275 19223 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34609
I20260809 01:57:51.619499 19223 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:51.619980 19223 heartbeater.cc:511] Master 127.14.175.254:34609 requested a full tablet report, sending...
I20260809 01:57:51.620968 18868 ts_manager.cc:194] Registered new tserver with Master: 7945686bc30642cc874099378e85b633 (127.14.175.194:37049)
I20260809 01:57:51.621524 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:53839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:51.635957 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:51.744485 19229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:51.744735 19229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:51.744807 19229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:51.748879 19229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:51.748957 19229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:51.749039 19229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:51.754066 19229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:51.755074 19229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:51.756036 19229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:51.765127 19235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.765203 19229 server_base.cc:1034] running on GCE node
W20260809 01:57:51.765058 19234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:51.765066 19237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:51.765662 19229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:51.766335 19229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:51.767515 19229 hybrid_clock.cc:648] HybridClock initialized: now 1786240671767506 us; error 27 us; skew 500 ppm
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:51.770164 19229 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:51.770941 19229 webserver.cc:460] Webserver started at http://127.14.175.195:45425/ using document root <none> and password file <none>
I20260809 01:57:51.771535 19229 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:51.771597 19229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:51.771751 19229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:51.773597 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "7085da4330cf43b79525946f7b34db5a"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "ea4c34073edaac326a177c7a6a52ab27"
server_key_iv: "131fb8ab987de4cbe261a1c4761fd370"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.774333 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "7085da4330cf43b79525946f7b34db5a"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "ea4c34073edaac326a177c7a6a52ab27"
server_key_iv: "131fb8ab987de4cbe261a1c4761fd370"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.777869 19229 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 01:57:51.780258 19246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.781522 19229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:51.781608 19229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "7085da4330cf43b79525946f7b34db5a"
format_stamp: "Formatted at 2026-08-09 01:57:51 on dist-test-slave-2w3w"
server_key: "ea4c34073edaac326a177c7a6a52ab27"
server_key_iv: "131fb8ab987de4cbe261a1c4761fd370"
server_key_version: "encryptionkey@0"
I20260809 01:57:51.781751 19229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:51.805335 19229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:51.808518 19229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:51.808712 19229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:51.809306 19229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:51.810112 19229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:51.810158 19229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.810220 19229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:51.810251 19229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:51.819509 19229 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:36327
I20260809 01:57:51.819543 19365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:36327 every 8 connection(s)
I20260809 01:57:51.820329 19229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:51.822068 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19229
I20260809 01:57:51.822230 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:51.822522 15039 external_mini_cluster.cc:1428] Setting key c0661e2d14f08618403d56504078810d
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:51.833635 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.822005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:60669 (local address 127.14.175.254:34609)
0809 01:57:51.822160 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.822165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.823040 (+ 875us) server_negotiation.cc:407] Connection header received
0809 01:57:51.824411 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.824414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.824471 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.824547 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.825635 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.826174 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.827381 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.827615 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.827727 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.830130 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.830134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.830136 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.830165 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.831565 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.832113 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.832117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.832119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.832202 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.832551 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.832555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.832556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.832741 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.832851 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.833337 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.833457 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 01:57:51.834393 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.822435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:34609 (local address 127.14.175.195:60669)
0809 01:57:51.822883 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:51.822933 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:51.824213 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:51.824702 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:51.824708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:51.825050 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:51.825496 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.825509 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.826302 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.826306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.827257 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:51.827267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.827762 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.827765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:51.827937 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.828529 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:51.828545 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:51.829973 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:51.831691 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.831697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.831711 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.832003 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.832298 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:51.832302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:51.832304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:51.832448 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:51.832857 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:51.832865 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:51.833094 (+ 229us) client_negotiation.cc:769] Sending connection context
0809 01:57:51.833285 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 01:57:51.833602 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":135,"threads_started":1}
I20260809 01:57:51.835733 19366 heartbeater.cc:347] Connected to a master server at 127.14.175.254:34609
I20260809 01:57:51.835968 19366 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:51.836504 19366 heartbeater.cc:511] Master 127.14.175.254:34609 requested a full tablet report, sending...
I20260809 01:57:51.837558 18868 ts_manager.cc:194] Registered new tserver with Master: 7085da4330cf43b79525946f7b34db5a (127.14.175.195:36327)
I20260809 01:57:51.838142 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:60669
I20260809 01:57:51.848107 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:51.874747 19373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.865161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44472 (local address 127.14.175.193:40239)
0809 01:57:51.865424 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.865444 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.865474 (+ 30us) server_negotiation.cc:407] Connection header received
0809 01:57:51.865523 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.865527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.865756 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.865917 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.866740 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.867604 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.868414 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.868865 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.868950 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.871422 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.871430 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.871443 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.871466 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.872903 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.873362 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.873367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.873368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.873445 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.873733 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.873736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.873738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.873978 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.874190 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.874400 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.874554 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":83,"threads_started":1}
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:51.885389 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:51.877618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.14.175.254:34609)
0809 01:57:51.877765 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:51.877768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:51.877782 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:57:51.877896 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:51.877898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:51.877939 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:51.878006 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:51.878541 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.879106 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.879900 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:51.880120 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:51.880209 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:51.882561 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:51.882564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:51.882566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:51.882590 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:51.883913 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.884303 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.884306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.884307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.884384 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:51.884611 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:51.884613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:51.884614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:51.884872 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:51.884977 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:51.885172 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 01:57:51.885272 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 01:57:51.885826 18868 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984
I20260809 01:57:51.886480 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18935
I20260809 01:57:51.894564 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19082
I20260809 01:57:51.901437 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19229
I20260809 01:57:51.907094 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 18835
2026-08-09T01:57:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2197 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[19379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[19379](info): set up 2 sockets
Aug 09 01:57:51 dist-test-slave-2w3w krb5kdc[19379](info): commencing operation
krb5kdc: starting...
W20260809 01:57:53.071936 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:53.202040 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39073
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:53.315536 19393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:53.315773 19393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:53.315822 19393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:53.320004 19393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:53.320053 19393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:53.320073 19393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:53.320111 19393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:53.320142 19393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:53.325187 19393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:53.326159 19393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:53.327167 19393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:53.335283 19398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:53.335300 19399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:53.335363 19401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:53.335489 19393 server_base.cc:1034] running on GCE node
I20260809 01:57:53.336158 19393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:53.337118 19393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:53.338297 19393 hybrid_clock.cc:648] HybridClock initialized: now 1786240673338273 us; error 47 us; skew 500 ppm
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:53.341253 19393 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:53.342038 19393 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:53.342103 19393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:53.342260 19393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:53.344265 19393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "82aa0753ad0b43a4914f150d9800ca4a"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "9ccc71e7483edf4464bd3630a4bd4548"
server_key_iv: "5c763dd0ba193bade07b8cabd03fbda1"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.344798 19393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "82aa0753ad0b43a4914f150d9800ca4a"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "9ccc71e7483edf4464bd3630a4bd4548"
server_key_iv: "5c763dd0ba193bade07b8cabd03fbda1"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.348588 19393 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 01:57:53.350764 19407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.351972 19393 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:57:53.352067 19393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "82aa0753ad0b43a4914f150d9800ca4a"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "9ccc71e7483edf4464bd3630a4bd4548"
server_key_iv: "5c763dd0ba193bade07b8cabd03fbda1"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.352145 19393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:53.381686 19393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:53.385073 19393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:53.385236 19393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:53.392407 19393 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:39073
I20260809 01:57:53.392711 19461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:39073 every 8 connection(s)
I20260809 01:57:53.393095 19393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:53.395737 19462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:53.399192 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19393
I20260809 01:57:53.399350 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:53.399641 15039 external_mini_cluster.cc:1428] Setting key b6e65bcd6214f56e4e971c1a8e976f62
I20260809 01:57:53.401497 19462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: Bootstrap starting.
I20260809 01:57:53.404001 19462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:53.404748 19462 log.cc:824] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:53.406813 19462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: No bootstrap required, opened a new log
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:53.410574 19462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } }
I20260809 01:57:53.410821 19462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:53.410903 19462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82aa0753ad0b43a4914f150d9800ca4a, State: Initialized, Role: FOLLOWER
I20260809 01:57:53.411384 19462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } }
I20260809 01:57:53.411545 19462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:53.411633 19462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:53.411737 19462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:53.412621 19462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } }
I20260809 01:57:53.412967 19462 leader_election.cc:302] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82aa0753ad0b43a4914f150d9800ca4a; no voters:
I20260809 01:57:53.413337 19462 leader_election.cc:288] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:53.413420 19468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:53.413654 19468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [term 1 LEADER]: Becoming Leader. State: Replica: 82aa0753ad0b43a4914f150d9800ca4a, State: Running, Role: LEADER
I20260809 01:57:53.414049 19468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } }
I20260809 01:57:53.414414 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:53.401043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.14.175.254:39073)
0809 01:57:53.401458 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:53.401472 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:53.401506 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:57:53.402162 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:53.402178 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:53.402494 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:53.402753 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:53.403706 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.404722 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.405814 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.406266 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.406391 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:53.409235 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:53.409240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:53.409251 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:53.409277 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:53.411224 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.411734 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.411742 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.411749 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.411905 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.412197 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.412200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.412202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.412593 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:53.412806 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:53.413095 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 01:57:53.413419 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":132,"threads_started":1}
I20260809 01:57:53.414642 19462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:53.415315 19468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82aa0753ad0b43a4914f150d9800ca4a. Latest consensus state: current_term: 1 leader_uuid: "82aa0753ad0b43a4914f150d9800ca4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } } }
I20260809 01:57:53.415956 19469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82aa0753ad0b43a4914f150d9800ca4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa0753ad0b43a4914f150d9800ca4a" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39073 } } }
I20260809 01:57:53.416080 19468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:53.416154 19469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:53.417204 19479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:53.420373 19479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:53.426028 19479 catalog_manager.cc:1347] Generated new cluster ID: 1cd2bce58183418abbac94ef368ea4e1
I20260809 01:57:53.426110 19479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:53.442237 19479 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:53.443203 19479 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:53.457837 19479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: Generated new TSK 0
I20260809 01:57:53.458516 19479 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:53.491830 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:53.601624 19492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:53.601867 19492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:53.601912 19492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:53.605789 19492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:53.605834 19492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:53.605887 19492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:53.610893 19492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:53.611900 19492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:53.612887 19492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:53.622053 19498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:53.622108 19492 server_base.cc:1034] running on GCE node
W20260809 01:57:53.622066 19497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:53.622059 19500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:53.622699 19492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:53.623343 19492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:53.624528 19492 hybrid_clock.cc:648] HybridClock initialized: now 1786240673624519 us; error 27 us; skew 500 ppm
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:53.627231 19492 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:53.628026 19492 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:53.628118 19492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:53.628346 19492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:53.630260 19492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "9f01adee1a364fb2b81eb285335a5c1d"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "ce8abce653032bd6d9b2ca5eb9b9fad4"
server_key_iv: "af0b5c8c1b4dca43f956e0e93f8bac81"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.630837 19492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "9f01adee1a364fb2b81eb285335a5c1d"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "ce8abce653032bd6d9b2ca5eb9b9fad4"
server_key_iv: "af0b5c8c1b4dca43f956e0e93f8bac81"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.634284 19492 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:57:53.636636 19506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.637966 19492 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 01:57:53.638090 19492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "9f01adee1a364fb2b81eb285335a5c1d"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "ce8abce653032bd6d9b2ca5eb9b9fad4"
server_key_iv: "af0b5c8c1b4dca43f956e0e93f8bac81"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.638198 19492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:53.654243 19492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:53.656985 19492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:53.657171 19492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:53.657698 19492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:53.658542 19492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:53.658620 19492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.658691 19492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:53.658735 19492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.667768 19492 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:39531
I20260809 01:57:53.667798 19633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:39531 every 8 connection(s)
I20260809 01:57:53.668375 19492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:53.678663 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19492
I20260809 01:57:53.678798 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:53.679216 15039 external_mini_cluster.cc:1428] Setting key e4a096cc792901fcf398e0749393d0fe
I20260809 01:57:53.682044 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:53.670014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35295 (local address 127.14.175.254:39073)
0809 01:57:53.670149 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:53.670152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:53.670877 (+ 725us) server_negotiation.cc:407] Connection header received
0809 01:57:53.672222 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:53.672226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:53.672288 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:53.672395 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:53.673543 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.674089 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.675298 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.675545 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.675655 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:53.678042 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:53.678048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:53.678056 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:53.678082 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:53.679761 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.680344 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.680347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.680348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.680432 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.680876 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.680880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.680882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.681104 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:53.681214 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:53.681654 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 01:57:53.681801 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:57:53.682644 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:53.670283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39073 (local address 127.14.175.193:35295)
0809 01:57:53.670732 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:53.670773 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:53.671995 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:53.672569 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:53.672575 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:53.672921 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:53.673379 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:53.673392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.674230 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.674234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:53.675172 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:53.675181 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.675708 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.675713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:53.675873 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:53.676458 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:53.676473 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:53.677875 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:53.679870 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:53.679876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:53.679889 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:53.680248 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:53.680568 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:53.680573 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:53.680576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:53.680770 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:53.681210 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:53.681214 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:53.681423 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 01:57:53.681571 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 01:57:53.681805 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":112,"threads_started":1}
I20260809 01:57:53.684012 19634 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39073
I20260809 01:57:53.684273 19634 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:53.684749 19634 heartbeater.cc:511] Master 127.14.175.254:39073 requested a full tablet report, sending...
I20260809 01:57:53.686211 19424 ts_manager.cc:194] Registered new tserver with Master: 9f01adee1a364fb2b81eb285335a5c1d (127.14.175.193:39531)
I20260809 01:57:53.687402 19424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:35295
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:53.707557 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:53.818220 19639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:53.818495 19639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:53.818570 19639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:53.822816 19639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:53.823009 19639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:53.823259 19639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:53.828436 19639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:53.829528 19639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:53.830588 19639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:53.839771 19644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:53.839946 19645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:53.839802 19647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:53.840066 19639 server_base.cc:1034] running on GCE node
I20260809 01:57:53.840499 19639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:53.841213 19639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:53.842415 19639 hybrid_clock.cc:648] HybridClock initialized: now 1786240673842396 us; error 30 us; skew 500 ppm
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:53.845292 19639 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:53.846028 19639 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:53.846135 19639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:53.846367 19639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:53.848385 19639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "7f5705fce9184fa5ab4b33c26f319f73"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "e07d0bc2186cb1726c356db601922d6f"
server_key_iv: "5ac1c8944bab432b776e64d7aefddaf2"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.848955 19639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "7f5705fce9184fa5ab4b33c26f319f73"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "e07d0bc2186cb1726c356db601922d6f"
server_key_iv: "5ac1c8944bab432b776e64d7aefddaf2"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.852473 19639 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:53.854717 19654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.855960 19639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:53.856125 19639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "7f5705fce9184fa5ab4b33c26f319f73"
format_stamp: "Formatted at 2026-08-09 01:57:53 on dist-test-slave-2w3w"
server_key: "e07d0bc2186cb1726c356db601922d6f"
server_key_iv: "5ac1c8944bab432b776e64d7aefddaf2"
server_key_version: "encryptionkey@0"
I20260809 01:57:53.856233 19639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:53.871217 19639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:53.873893 19639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:53.874092 19639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:53.874643 19639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:53.875471 19639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:53.875545 19639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.875613 19639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:53.875662 19639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:53.884752 19639 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:35041
I20260809 01:57:53.884773 19774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:35041 every 8 connection(s)
I20260809 01:57:53.885354 19639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
Aug 09 01:57:53 dist-test-slave-2w3w krb5kdc[19379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240673, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:53.894935 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19639
I20260809 01:57:53.895087 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:53.895450 15039 external_mini_cluster.cc:1428] Setting key ca5721e832469b58461f479c2bb80745
I20260809 01:57:53.899289 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:53.887133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:44131 (local address 127.14.175.254:39073)
0809 01:57:53.887301 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:53.887305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:53.888068 (+ 763us) server_negotiation.cc:407] Connection header received
0809 01:57:53.889320 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:53.889324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:53.889384 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:53.889467 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:53.890666 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.891301 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.892438 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.892680 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.892803 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:53.895416 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:53.895419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:53.895421 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:53.895447 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:53.897117 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.897702 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.897704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.897705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.897785 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:53.898188 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:53.898190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:53.898191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:53.898375 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:53.898475 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:53.899070 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 01:57:53.899167 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 01:57:53.900172 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:53.887478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39073 (local address 127.14.175.194:44131)
0809 01:57:53.887911 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:53.887954 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:53.889105 (+ 1151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:53.889657 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:53.889664 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:53.890012 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:53.890465 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:53.890477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.891438 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.891442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:53.892306 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:53.892315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:53.892851 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:53.892860 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:53.893019 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:53.893619 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:53.893635 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:53.895220 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:53.897242 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:53.897248 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:53.897260 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:53.897601 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:53.897880 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:53.897886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:53.897890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:53.898091 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:53.898483 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:53.898491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:53.898788 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 01:57:53.899022 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 01:57:53.899361 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":106,"threads_started":1}
I20260809 01:57:53.901207 19776 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39073
I20260809 01:57:53.901432 19776 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:53.901911 19776 heartbeater.cc:511] Master 127.14.175.254:39073 requested a full tablet report, sending...
I20260809 01:57:53.903038 19424 ts_manager.cc:194] Registered new tserver with Master: 7f5705fce9184fa5ab4b33c26f319f73 (127.14.175.194:35041)
I20260809 01:57:53.903597 19424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:44131
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:53.925603 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:54.034912 19781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:54.035244 19781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:54.035323 19781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:54.040762 19781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:54.040828 19781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:54.040926 19781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:54.046478 19781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:54.047518 19781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:54.048441 19781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:54.057682 19789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:54.057741 19786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:54.057688 19787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:54.057816 19781 server_base.cc:1034] running on GCE node
I20260809 01:57:54.058367 19781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:54.058940 19781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:54.060194 19781 hybrid_clock.cc:648] HybridClock initialized: now 1786240674060176 us; error 36 us; skew 500 ppm
Aug 09 01:57:54 dist-test-slave-2w3w krb5kdc[19379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240674, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:54.063086 19781 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:54.063768 19781 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:54.063870 19781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:54.064101 19781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:54.066032 19781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "2969d90eff7d4608b9387c6f45ecb0ae"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "f3b4cff6bc6be36f6afcffe23694ed59"
server_key_iv: "f7d5fbb517ce635181db459e700e8cc3"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.066576 19781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "2969d90eff7d4608b9387c6f45ecb0ae"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "f3b4cff6bc6be36f6afcffe23694ed59"
server_key_iv: "f7d5fbb517ce635181db459e700e8cc3"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.069979 19781 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:54.072319 19796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.073403 19781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:54.073540 19781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "2969d90eff7d4608b9387c6f45ecb0ae"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "f3b4cff6bc6be36f6afcffe23694ed59"
server_key_iv: "f7d5fbb517ce635181db459e700e8cc3"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.073645 19781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:54.099437 19781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:54.102013 19781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:54.102207 19781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:54.102730 19781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:54.103590 19781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:54.103659 19781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.103729 19781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:54.103783 19781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.112427 19781 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:35927
I20260809 01:57:54.112449 19921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:35927 every 8 connection(s)
I20260809 01:57:54.113087 19781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:54.121825 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19781
I20260809 01:57:54.121973 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:54.122257 15039 external_mini_cluster.cc:1428] Setting key d99ee5dc9641c94540d6d5c81cbec773
Aug 09 01:57:54 dist-test-slave-2w3w krb5kdc[19379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240674, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:54.126363 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.114684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:46799 (local address 127.14.175.254:39073)
0809 01:57:54.114833 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.114837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.115694 (+ 857us) server_negotiation.cc:407] Connection header received
0809 01:57:54.116945 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.116948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.117005 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.117115 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:54.118214 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.118764 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.119952 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.120179 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.120292 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.123029 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:54.123032 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:54.123035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:54.123063 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:54.124701 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:54.125153 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:54.125155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:54.125156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:54.125230 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:54.125509 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:54.125512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:54.125513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:54.125672 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:54.125744 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.126157 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.126247 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 01:57:54.127149 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.115110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39073 (local address 127.14.175.195:46799)
0809 01:57:54.115557 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.115598 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.116743 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.117282 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.117289 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.117629 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:54.118067 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.118079 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.118894 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.118904 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.119823 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.119832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.120326 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.120331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.120497 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.120993 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:54.121016 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:54.122775 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:54.124801 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:54.124806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:54.124815 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:54.125066 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:54.125307 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:54.125309 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:54.125311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:54.125432 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:54.125756 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:54.125760 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:54.125956 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.126110 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.126327 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260809 01:57:54.128204 19923 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39073
I20260809 01:57:54.128418 19923 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:54.128831 19923 heartbeater.cc:511] Master 127.14.175.254:39073 requested a full tablet report, sending...
I20260809 01:57:54.129753 19424 ts_manager.cc:194] Registered new tserver with Master: 2969d90eff7d4608b9387c6f45ecb0ae (127.14.175.195:35927)
I20260809 01:57:54.130304 19424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:46799
I20260809 01:57:54.136236 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:57:54.144863 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.138172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58278 (local address 127.14.175.254:39073)
0809 01:57:54.138324 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.138329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.138476 (+ 147us) server_negotiation.cc:407] Connection header received
0809 01:57:54.138552 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.138554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.138588 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.138652 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:54.139385 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.139857 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.140622 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.140820 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.140893 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.142169 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:54.142172 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:54.142174 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:54.142194 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:54.143530 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:54.143903 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:54.143905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:54.143906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:54.143977 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:54.144202 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:54.144204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:54.144205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:54.144385 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:54.144485 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.144670 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.144753 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 01:57:54.147394 19424 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:54.150224 19424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:54.164175 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.158077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:35927 (local address 127.0.0.1:45914)
0809 01:57:54.158580 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.158628 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.158737 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.159745 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.159754 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.159777 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:54.160018 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.160025 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.161441 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.161445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.162892 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.162901 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.163777 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.163779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.163867 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.163896 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.163977 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.164068 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":75,"thread_start_us":80,"threads_started":1}
I20260809 01:57:54.164515 19937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.158171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45914 (local address 127.14.175.195:35927)
0809 01:57:54.159058 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.159071 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.159093 (+ 22us) server_negotiation.cc:407] Connection header received
0809 01:57:54.159167 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.159172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.159369 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.159558 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:54.160152 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.161299 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.163036 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.163655 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.163775 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.163899 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.164019 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.164110 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":105,"threads_started":1}
I20260809 01:57:54.164901 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.158317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:39531 (local address 127.0.0.1:52570)
0809 01:57:54.158828 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.158842 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.158936 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.159763 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.159768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.159789 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:54.160016 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.160025 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.161939 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.161943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.163440 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.163451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.164526 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.164528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.164651 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.164678 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.164740 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.164805 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":159,"thread_start_us":88,"threads_started":1}
I20260809 01:57:54.165632 19941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.158792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52570 (local address 127.14.175.193:39531)
0809 01:57:54.159332 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.159337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.159356 (+ 19us) server_negotiation.cc:407] Connection header received
0809 01:57:54.159436 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.159442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.159619 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.159820 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:54.160870 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.161791 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.163580 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.164408 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.164535 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.165351 (+ 816us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.165401 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.165485 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":97,"threads_started":1}
I20260809 01:57:54.167695 19940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.158745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:35041 (local address 127.0.0.1:55974)
0809 01:57:54.160045 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.160056 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.160170 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.160679 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.160682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.160702 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:54.160779 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.160783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.162014 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.162017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.163440 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.163451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.167293 (+ 3842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.167298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.167387 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.167410 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.167490 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.167574 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"mutex_wait_us":121,"thread_start_us":93,"threads_started":1}
I20260809 01:57:54.167457 19853 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4f6787450841578c93e18e6e547138 (DEFAULT_TABLE table=test-table [id=5350b4678816421087d131871ac2491f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:54.168213 19942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.159277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.14.175.194:35041)
0809 01:57:54.159605 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.159617 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.160268 (+ 651us) server_negotiation.cc:407] Connection header received
0809 01:57:54.160349 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.160355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.160538 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.160683 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:54.160952 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.161876 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.166351 (+ 4475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.167163 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.167287 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.167394 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.167968 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.168071 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":124,"threads_started":1}
I20260809 01:57:54.168023 19558 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4f6787450841578c93e18e6e547138 (DEFAULT_TABLE table=test-table [id=5350b4678816421087d131871ac2491f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:54.168521 19853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4f6787450841578c93e18e6e547138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:54.168967 19558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4f6787450841578c93e18e6e547138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:54.170888 19705 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4f6787450841578c93e18e6e547138 (DEFAULT_TABLE table=test-table [id=5350b4678816421087d131871ac2491f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:54.171849 19705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4f6787450841578c93e18e6e547138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:54.174523 19943 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Bootstrap starting.
I20260809 01:57:54.175872 19944 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Bootstrap starting.
I20260809 01:57:54.177904 19943 tablet_bootstrap.cc:654] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:54.177904 19944 tablet_bootstrap.cc:654] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:54.179245 19945 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Bootstrap starting.
I20260809 01:57:54.179255 19944 log.cc:824] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:54.179427 19943 log.cc:824] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:54.181331 19944 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: No bootstrap required, opened a new log
I20260809 01:57:54.181361 19943 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: No bootstrap required, opened a new log
I20260809 01:57:54.181519 19944 ts_tablet_manager.cc:1397] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:57:54.181545 19943 ts_tablet_manager.cc:1397] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 01:57:54.181908 19945 tablet_bootstrap.cc:654] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:54.182708 19945 log.cc:824] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:54.184652 19945 tablet_bootstrap.cc:492] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: No bootstrap required, opened a new log
I20260809 01:57:54.184828 19945 ts_tablet_manager.cc:1397] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:57:54.184639 19944 raft_consensus.cc:348] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.184916 19944 raft_consensus.cc:374] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:54.184973 19944 raft_consensus.cc:729] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f01adee1a364fb2b81eb285335a5c1d, State: Initialized, Role: FOLLOWER
I20260809 01:57:54.185406 19944 consensus_queue.cc:260] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.185328 19943 raft_consensus.cc:348] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.185586 19943 raft_consensus.cc:374] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:54.185647 19943 raft_consensus.cc:729] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2969d90eff7d4608b9387c6f45ecb0ae, State: Initialized, Role: FOLLOWER
I20260809 01:57:54.185988 19634 heartbeater.cc:503] Master 127.14.175.254:39073 was elected leader, sending a full tablet report...
I20260809 01:57:54.186102 19943 consensus_queue.cc:260] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.186295 19944 ts_tablet_manager.cc:1428] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 01:57:54.186991 19943 ts_tablet_manager.cc:1428] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 01:57:54.187319 19923 heartbeater.cc:503] Master 127.14.175.254:39073 was elected leader, sending a full tablet report...
I20260809 01:57:54.188462 19945 raft_consensus.cc:348] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.188755 19945 raft_consensus.cc:374] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:54.188813 19945 raft_consensus.cc:729] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f5705fce9184fa5ab4b33c26f319f73, State: Initialized, Role: FOLLOWER
I20260809 01:57:54.189241 19945 consensus_queue.cc:260] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.189900 19776 heartbeater.cc:503] Master 127.14.175.254:39073 was elected leader, sending a full tablet report...
I20260809 01:57:54.190208 19945 ts_tablet_manager.cc:1428] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 01:57:54.364066 19925 tablet.cc:2369] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:57:54.386457 19777 tablet.cc:2369] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:54.397945 19952 raft_consensus.cc:482] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:54.398130 19952 raft_consensus.cc:504] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.399272 19952 leader_election.cc:288] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2969d90eff7d4608b9387c6f45ecb0ae (127.14.175.195:35927), 9f01adee1a364fb2b81eb285335a5c1d (127.14.175.193:39531)
I20260809 01:57:54.403612 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.399469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:35927 (local address 127.14.175.194:53581)
0809 01:57:54.399661 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.399676 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.399755 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.400330 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.400332 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.400347 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:54.400441 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.400446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.401412 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.401415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.402450 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.402461 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.403167 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.403171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.403282 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.403305 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.403379 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.403449 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 01:57:54.403647 19937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.399929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53581 (local address 127.14.175.195:35927)
0809 01:57:54.400077 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.400081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.400092 (+ 11us) server_negotiation.cc:407] Connection header received
0809 01:57:54.400134 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.400136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.400171 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.400264 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:54.400559 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.401293 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.402566 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.403052 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.403181 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.403237 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.403446 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.403528 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:57:54.403805 19941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.399749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:33421 (local address 127.14.175.193:39531)
0809 01:57:54.399921 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.399926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.399941 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:54.400080 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.400083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.400132 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.400204 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:57:54.400527 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.401034 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.402529 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.403207 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.403319 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.403366 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.403581 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.403671 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 01:57:54.404155 19953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.399505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:39531 (local address 127.14.175.194:33421)
0809 01:57:54.399854 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.399869 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.399963 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.400237 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.400241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.400261 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:57:54.400408 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.400414 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.401144 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.401150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.402396 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:54.402406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.403327 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.403334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:54.403443 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.403462 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.403930 (+ 468us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.404007 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":92,"threads_started":1}
I20260809 01:57:54.404285 19874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4f6787450841578c93e18e6e547138" candidate_uuid: "7f5705fce9184fa5ab4b33c26f319f73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" is_pre_election: true
I20260809 01:57:54.404575 19874 raft_consensus.cc:2454] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f5705fce9184fa5ab4b33c26f319f73 in term 0.
I20260809 01:57:54.404769 19579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4f6787450841578c93e18e6e547138" candidate_uuid: "7f5705fce9184fa5ab4b33c26f319f73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f01adee1a364fb2b81eb285335a5c1d" is_pre_election: true
I20260809 01:57:54.405109 19579 raft_consensus.cc:2454] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f5705fce9184fa5ab4b33c26f319f73 in term 0.
I20260809 01:57:54.405089 19657 leader_election.cc:302] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2969d90eff7d4608b9387c6f45ecb0ae, 7f5705fce9184fa5ab4b33c26f319f73; no voters:
I20260809 01:57:54.405597 19952 raft_consensus.cc:2781] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:54.405673 19952 raft_consensus.cc:482] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:54.405702 19952 raft_consensus.cc:3037] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:54.406785 19952 raft_consensus.cc:504] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.407166 19952 leader_election.cc:288] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [CANDIDATE]: Term 1 election: Requested vote from peers 2969d90eff7d4608b9387c6f45ecb0ae (127.14.175.195:35927), 9f01adee1a364fb2b81eb285335a5c1d (127.14.175.193:39531)
I20260809 01:57:54.407519 19874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4f6787450841578c93e18e6e547138" candidate_uuid: "7f5705fce9184fa5ab4b33c26f319f73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2969d90eff7d4608b9387c6f45ecb0ae"
I20260809 01:57:54.407531 19579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4f6787450841578c93e18e6e547138" candidate_uuid: "7f5705fce9184fa5ab4b33c26f319f73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f01adee1a364fb2b81eb285335a5c1d"
I20260809 01:57:54.407653 19874 raft_consensus.cc:3037] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:54.407665 19579 raft_consensus.cc:3037] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:54.408668 19874 raft_consensus.cc:2454] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f5705fce9184fa5ab4b33c26f319f73 in term 1.
I20260809 01:57:54.408706 19579 raft_consensus.cc:2454] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f5705fce9184fa5ab4b33c26f319f73 in term 1.
I20260809 01:57:54.409004 19657 leader_election.cc:302] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2969d90eff7d4608b9387c6f45ecb0ae, 7f5705fce9184fa5ab4b33c26f319f73; no voters:
I20260809 01:57:54.409180 19952 raft_consensus.cc:2781] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:54.409394 19952 raft_consensus.cc:686] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 1 LEADER]: Becoming Leader. State: Replica: 7f5705fce9184fa5ab4b33c26f319f73, State: Running, Role: LEADER
I20260809 01:57:54.409731 19952 consensus_queue.cc:237] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } }
I20260809 01:57:54.412711 19424 catalog_manager.cc:5495] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f5705fce9184fa5ab4b33c26f319f73 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "7f5705fce9184fa5ab4b33c26f319f73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f5705fce9184fa5ab4b33c26f319f73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35041 } health_report { overall_health: HEALTHY } } }
W20260809 01:57:54.419611 19635 tablet.cc:2369] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:54.460120 19942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.456662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55980 (local address 127.14.175.194:35041)
0809 01:57:54.456789 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.456792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.456806 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:57:54.456877 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.456879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.456933 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.457022 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:57:54.457313 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.457838 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.458668 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:54.458877 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:54.458948 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:54.459289 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:57:54.459682 (+ 393us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:57:54.459771 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.459898 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.459946 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 01:57:54.465725 19874 raft_consensus.cc:1261] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 1 FOLLOWER]: Refusing update from remote peer 7f5705fce9184fa5ab4b33c26f319f73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:54.465735 19579 raft_consensus.cc:1261] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 1 FOLLOWER]: Refusing update from remote peer 7f5705fce9184fa5ab4b33c26f319f73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:54.466508 19954 consensus_queue.cc:1035] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2969d90eff7d4608b9387c6f45ecb0ae" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 35927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:54.466687 19952 consensus_queue.cc:1035] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f01adee1a364fb2b81eb285335a5c1d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 39531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:54.476444 19959 mvcc.cc:205] Tried to move back new op lower bound from 7316441802604695552 to 7316441802385014784. Current Snapshot: MvccSnapshot[applied={T|T < 7316441802604695552 or (T in {7316441802604695552})}]
I20260809 01:57:54.483166 19423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:54.483347 19423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:54.485832 19423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82aa0753ad0b43a4914f150d9800ca4a: Sending DeleteTablet for 3 replicas of tablet 4e4f6787450841578c93e18e6e547138
I20260809 01:57:54.486589 19853 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4f6787450841578c93e18e6e547138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:54 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:45914
I20260809 01:57:54.486580 19558 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4f6787450841578c93e18e6e547138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:54 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:52570
I20260809 01:57:54.486661 19705 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4f6787450841578c93e18e6e547138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:54 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:55974
I20260809 01:57:54.487068 19967 tablet_replica.cc:330] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: stopping tablet replica
I20260809 01:57:54.487068 19968 tablet_replica.cc:330] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d: stopping tablet replica
I20260809 01:57:54.487280 19969 tablet_replica.cc:330] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: stopping tablet replica
I20260809 01:57:54.487360 19968 raft_consensus.cc:2229] T 4e4f6787450841578c93e18e6e547138 P 9f01adee1a364fb2b81eb285335a5c1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:54.487360 19967 raft_consensus.cc:2229] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:54.487592 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19492
I20260809 01:57:54.487747 19969 raft_consensus.cc:2229] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:54.488171 19969 raft_consensus.cc:2258] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:54.487649 19967 raft_consensus.cc:2258] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:54.490334 19969 ts_tablet_manager.cc:1905] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:54.493005 19969 ts_tablet_manager.cc:1918] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:57:54.493093 19969 log.cc:1196] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/4e4f6787450841578c93e18e6e547138
I20260809 01:57:54.493412 19969 ts_tablet_manager.cc:1939] T 4e4f6787450841578c93e18e6e547138 P 7f5705fce9184fa5ab4b33c26f319f73: Deleting consensus metadata
I20260809 01:57:54.494541 19410 catalog_manager.cc:4841] TS 7f5705fce9184fa5ab4b33c26f319f73 (127.14.175.194:35041): tablet 4e4f6787450841578c93e18e6e547138 (table test-table [id=5350b4678816421087d131871ac2491f]) successfully deleted
I20260809 01:57:54.495076 19967 ts_tablet_manager.cc:1905] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:54.498353 19967 ts_tablet_manager.cc:1918] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:57:54.498456 19967 log.cc:1196] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/4e4f6787450841578c93e18e6e547138
I20260809 01:57:54.498796 19967 ts_tablet_manager.cc:1939] T 4e4f6787450841578c93e18e6e547138 P 2969d90eff7d4608b9387c6f45ecb0ae: Deleting consensus metadata
I20260809 01:57:54.500041 19410 catalog_manager.cc:4841] TS 2969d90eff7d4608b9387c6f45ecb0ae (127.14.175.195:35927): tablet 4e4f6787450841578c93e18e6e547138 (table test-table [id=5350b4678816421087d131871ac2491f]) successfully deleted
W20260809 01:57:54.500089 19408 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:39531 (error 108)
I20260809 01:57:54.500216 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19639
I20260809 01:57:54.504091 19940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.502370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:39531 (local address 127.0.0.1:52578)
0809 01:57:54.503899 (+ 1529us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.503986 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:39531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1376}
W20260809 01:57:54.504416 19408 catalog_manager.cc:4584] TS 9f01adee1a364fb2b81eb285335a5c1d (127.14.175.193:39531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e4f6787450841578c93e18e6e547138: Network error: Client connection negotiation failed: client connection to 127.14.175.193:39531: connect: Connection refused (error 111)
I20260809 01:57:54.508870 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19781
I20260809 01:57:54.515781 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19393
2026-08-09T01:57:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2609 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T01:57:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:54Z Disabled control of system clock
I20260809 01:57:54.547654 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:38707
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:38707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 01:57:54.657627 19976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:54.657869 19976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:54.657907 19976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:54.661706 19976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:54.661749 19976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:54.661769 19976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:54.661785 19976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:54.661800 19976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:54.666399 19976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:38707
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:38707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:54.667268 19976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:54.668473 19976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:54.676879 19982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:54.676879 19985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:54.676926 19976 server_base.cc:1034] running on GCE node
W20260809 01:57:54.676878 19983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:54.677614 19976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:54.678642 19976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:54.679840 19976 hybrid_clock.cc:648] HybridClock initialized: now 1786240674679800 us; error 53 us; skew 500 ppm
I20260809 01:57:54.681690 19976 webserver.cc:460] Webserver started at http://127.14.175.254:45859/ using document root <none> and password file <none>
I20260809 01:57:54.682243 19976 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:54.682356 19976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:54.682591 19976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:54.684648 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "ae0b3c786b5542baa9adac19441e05b1"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "94eabe0a0dca1bb536145fe030ffac52"
server_key_iv: "6f09803a0cea35577344ed43834dce4e"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.685213 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "ae0b3c786b5542baa9adac19441e05b1"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "94eabe0a0dca1bb536145fe030ffac52"
server_key_iv: "6f09803a0cea35577344ed43834dce4e"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.688853 19976 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 01:57:54.691226 19992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.692358 19976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:57:54.692502 19976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "ae0b3c786b5542baa9adac19441e05b1"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "94eabe0a0dca1bb536145fe030ffac52"
server_key_iv: "6f09803a0cea35577344ed43834dce4e"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.692622 19976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:54.697196 19976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:54.697793 19976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:54.697980 19976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:54.705020 20049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:38707 every 8 connection(s)
I20260809 01:57:54.705018 19976 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:38707
I20260809 01:57:54.705986 19976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:54.709322 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:54.712992 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 19976
I20260809 01:57:54.713109 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:54.713457 15039 external_mini_cluster.cc:1428] Setting key bec0942027e0319f1c3e75ca1ad58678
I20260809 01:57:54.715241 20050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: Bootstrap starting.
I20260809 01:57:54.717520 20050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:54.718459 20050 log.cc:824] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:54.719810 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.715065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54320 (local address 127.14.175.254:38707)
0809 01:57:54.715817 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.715838 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.715878 (+ 40us) server_negotiation.cc:407] Connection header received
0809 01:57:54.716633 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.716650 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.717049 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.717431 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:54.718441 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:54.718446 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:54.718458 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:54.718470 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:54.718528 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:54.718545 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:54.718678 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.718799 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.719100 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":162,"threads_started":1}
I20260809 01:57:54.720505 20050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: No bootstrap required, opened a new log
I20260809 01:57:54.724076 20050 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } }
I20260809 01:57:54.724306 20050 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:54.724395 20050 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0b3c786b5542baa9adac19441e05b1, State: Initialized, Role: FOLLOWER
I20260809 01:57:54.724900 20050 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } }
I20260809 01:57:54.725025 20050 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:54.725065 20050 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:54.725132 20050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:54.725970 20050 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } }
I20260809 01:57:54.726296 20050 leader_election.cc:302] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae0b3c786b5542baa9adac19441e05b1; no voters:
I20260809 01:57:54.726603 20050 leader_election.cc:288] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:54.726750 20055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:54.727007 20055 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [term 1 LEADER]: Becoming Leader. State: Replica: ae0b3c786b5542baa9adac19441e05b1, State: Running, Role: LEADER
I20260809 01:57:54.727324 20055 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } }
I20260809 01:57:54.727893 20050 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:54.729087 20057 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae0b3c786b5542baa9adac19441e05b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } } }
I20260809 01:57:54.729218 20057 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:54.729458 20058 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae0b3c786b5542baa9adac19441e05b1. Latest consensus state: current_term: 1 leader_uuid: "ae0b3c786b5542baa9adac19441e05b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae0b3c786b5542baa9adac19441e05b1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38707 } } }
I20260809 01:57:54.729576 20058 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:54.729696 20065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:54.732792 20065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:54.738034 20065 catalog_manager.cc:1347] Generated new cluster ID: 047f03c325374f79900a8a0f2f86585c
I20260809 01:57:54.738097 20065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:54.753770 20065 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:54.754084 20065 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:54.758816 20065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: Generated new TSK 0
I20260809 01:57:54.759562 20065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:57:54.773623 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--builtin_ntp_servers=127.14.175.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 01:57:54.889163 20075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:54.889433 20075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:54.889473 20075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:54.893811 20075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:54.893869 20075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:54.893959 20075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:54.898850 20075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:54.899950 20075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:54.901297 20075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:54.910879 20080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:54.910980 20075 server_base.cc:1034] running on GCE node
W20260809 01:57:54.910841 20083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:54.910862 20081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:54.911481 20075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:54.912099 20075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:54.913260 20075 hybrid_clock.cc:648] HybridClock initialized: now 1786240674913242 us; error 30 us; skew 500 ppm
I20260809 01:57:54.915081 20075 webserver.cc:460] Webserver started at http://127.14.175.193:42319/ using document root <none> and password file <none>
I20260809 01:57:54.915601 20075 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:54.915659 20075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:54.915815 20075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:54.917783 20075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "fea9dc584f1c46f5837327f34c8a2620"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "bcb7ce1cd7143ffbc73beba206e921ed"
server_key_iv: "1d04e7c11b0f26a36244760cff8f470d"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.918290 20075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "fea9dc584f1c46f5837327f34c8a2620"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "bcb7ce1cd7143ffbc73beba206e921ed"
server_key_iv: "1d04e7c11b0f26a36244760cff8f470d"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.921793 20075 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:57:54.924305 20089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.925500 20075 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:54.925593 20075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "fea9dc584f1c46f5837327f34c8a2620"
format_stamp: "Formatted at 2026-08-09 01:57:54 on dist-test-slave-2w3w"
server_key: "bcb7ce1cd7143ffbc73beba206e921ed"
server_key_iv: "1d04e7c11b0f26a36244760cff8f470d"
server_key_version: "encryptionkey@0"
I20260809 01:57:54.925678 20075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:54.930291 20075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:54.930821 20075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:54.931030 20075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:54.931504 20075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:54.932324 20075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:54.932376 20075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.932412 20075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:54.932435 20075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:54.940864 20075 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:37533
I20260809 01:57:54.940891 20214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:37533 every 8 connection(s)
I20260809 01:57:54.941711 20075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:54.947898 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.943552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:33157 (local address 127.14.175.254:38707)
0809 01:57:54.943688 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:54.943692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:54.944678 (+ 986us) server_negotiation.cc:407] Connection header received
0809 01:57:54.946071 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:54.946075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:54.946121 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:54.946227 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:54.947417 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:54.947421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:54.947423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:54.947436 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:54.947458 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:54.947469 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:54.947575 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:54.947720 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 01:57:54.947767 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:57:54.948676 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:54.943914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38707 (local address 127.14.175.193:33157)
0809 01:57:54.944533 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:54.944573 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:54.945857 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:54.946407 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:54.946414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:54.946523 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:54.947163 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:54.947164 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:54.947203 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:54.947268 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:54.947558 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:54.947568 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:54.947574 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:57:54.947753 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 01:57:54.947977 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
I20260809 01:57:54.949858 20215 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38707
I20260809 01:57:54.950098 20215 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:54.950482 20215 heartbeater.cc:511] Master 127.14.175.254:38707 requested a full tablet report, sending...
I20260809 01:57:54.950573 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20075
I20260809 01:57:54.950738 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:54.951100 15039 external_mini_cluster.cc:1428] Setting key 969de436fd3e15d1ed11c1882cc30bc7
I20260809 01:57:54.952054 20011 ts_manager.cc:194] Registered new tserver with Master: fea9dc584f1c46f5837327f34c8a2620 (127.14.175.193:37533)
I20260809 01:57:54.953166 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--builtin_ntp_servers=127.14.175.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 01:57:55.067625 20218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:55.067893 20218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:55.067934 20218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:55.072014 20218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:55.072068 20218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:55.072150 20218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:55.076905 20218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:55.077961 20218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:55.079368 20218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:55.088963 20223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:55.088999 20224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:55.089152 20226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:55.089186 20218 server_base.cc:1034] running on GCE node
I20260809 01:57:55.089708 20218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:55.090378 20218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:55.091542 20218 hybrid_clock.cc:648] HybridClock initialized: now 1786240675091529 us; error 24 us; skew 500 ppm
I20260809 01:57:55.093405 20218 webserver.cc:460] Webserver started at http://127.14.175.194:36533/ using document root <none> and password file <none>
I20260809 01:57:55.094017 20218 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:55.094079 20218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:55.094306 20218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:55.096570 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "9504f909af4a4c57b2d1789b6c048916"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "e3327fca4dcdaa8f8f9e079ccf12b23b"
server_key_iv: "e26b7921189eb4fbe0833d2a66ba49bb"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.097167 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "9504f909af4a4c57b2d1789b6c048916"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "e3327fca4dcdaa8f8f9e079ccf12b23b"
server_key_iv: "e26b7921189eb4fbe0833d2a66ba49bb"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.100883 20218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:55.103493 20232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.104797 20218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:55.104943 20218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "9504f909af4a4c57b2d1789b6c048916"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "e3327fca4dcdaa8f8f9e079ccf12b23b"
server_key_iv: "e26b7921189eb4fbe0833d2a66ba49bb"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.105051 20218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:55.109632 20218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:55.110201 20218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:55.110386 20218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:55.110976 20218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:55.111883 20218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:55.111932 20218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.111994 20218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:55.112030 20218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.120936 20218 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44623
I20260809 01:57:55.120960 20352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44623 every 8 connection(s)
I20260809 01:57:55.121758 20218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:55.127707 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.123534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:51713 (local address 127.14.175.254:38707)
0809 01:57:55.123689 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.123695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.124799 (+ 1104us) server_negotiation.cc:407] Connection header received
0809 01:57:55.126042 (+ 1243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.126045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.126082 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.126155 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.127220 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.127224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.127226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.127237 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.127256 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.127264 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.127341 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.127559 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.127602 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 01:57:55.128942 20355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.123987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38707 (local address 127.14.175.194:51713)
0809 01:57:55.124656 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.124695 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.125860 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.126324 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.126331 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.126412 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.126905 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.126907 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.126944 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.127083 (+ 139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.127407 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.127416 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.127421 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.127592 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.127904 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":111,"threads_started":1}
I20260809 01:57:55.129854 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20218
I20260809 01:57:55.130030 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:55.130169 20353 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38707
I20260809 01:57:55.130398 20353 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:55.130411 15039 external_mini_cluster.cc:1428] Setting key c91855e067e780a5a5b42db6e5389811
I20260809 01:57:55.130787 20353 heartbeater.cc:511] Master 127.14.175.254:38707 requested a full tablet report, sending...
I20260809 01:57:55.131878 20011 ts_manager.cc:194] Registered new tserver with Master: 9504f909af4a4c57b2d1789b6c048916 (127.14.175.194:44623)
I20260809 01:57:55.132766 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--builtin_ntp_servers=127.14.175.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 01:57:55.244356 20356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:55.244633 20356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:55.244674 20356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:55.248796 20356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:55.248857 20356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:55.248944 20356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:55.253835 20356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:55.255046 20356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:55.256436 20356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:55.266172 20362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:55.266337 20356 server_base.cc:1034] running on GCE node
W20260809 01:57:55.266207 20361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:55.266510 20364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:55.267026 20356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:55.267611 20356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:55.268769 20356 hybrid_clock.cc:648] HybridClock initialized: now 1786240675268756 us; error 25 us; skew 500 ppm
I20260809 01:57:55.270639 20356 webserver.cc:460] Webserver started at http://127.14.175.195:39443/ using document root <none> and password file <none>
I20260809 01:57:55.271296 20356 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:55.271394 20356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:55.271631 20356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:55.273671 20356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "bb30304b665840338998f59c71e3b350"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "c237d122a8d369551d56c6eb21916bfd"
server_key_iv: "17334a9caf171f70a48704adf9f8ed06"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.274273 20356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "bb30304b665840338998f59c71e3b350"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "c237d122a8d369551d56c6eb21916bfd"
server_key_iv: "17334a9caf171f70a48704adf9f8ed06"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.277918 20356 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:57:55.280469 20370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.281666 20356 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:55.281811 20356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "bb30304b665840338998f59c71e3b350"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "c237d122a8d369551d56c6eb21916bfd"
server_key_iv: "17334a9caf171f70a48704adf9f8ed06"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.281932 20356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:55.286537 20356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:55.287207 20356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:55.287392 20356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:55.287926 20356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:55.288832 20356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:55.288904 20356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.288975 20356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:55.289027 20356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.298689 20356 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:37253
I20260809 01:57:55.298714 20494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:37253 every 8 connection(s)
I20260809 01:57:55.299649 20356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:57:55.305948 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.301501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48111 (local address 127.14.175.254:38707)
0809 01:57:55.301648 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.301652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.302730 (+ 1078us) server_negotiation.cc:407] Connection header received
0809 01:57:55.304192 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.304196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.304244 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.304341 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.305469 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.305473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.305476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.305489 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.305513 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.305525 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.305613 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.305764 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.305811 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 01:57:55.306993 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.301861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38707 (local address 127.14.175.195:48111)
0809 01:57:55.302585 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.302625 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.303981 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.304498 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.304505 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.304589 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.305204 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.305206 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.305245 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.305313 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.305595 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.305603 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.305608 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.305794 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.306041 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":119,"threads_started":1}
I20260809 01:57:55.309178 20495 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38707
I20260809 01:57:55.309384 20495 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:55.309701 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20356
I20260809 01:57:55.309837 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:55.309940 20495 heartbeater.cc:511] Master 127.14.175.254:38707 requested a full tablet report, sending...
I20260809 01:57:55.310189 15039 external_mini_cluster.cc:1428] Setting key e81dfb0882f9437f377cecc10bbb41d7
I20260809 01:57:55.311444 20011 ts_manager.cc:194] Registered new tserver with Master: bb30304b665840338998f59c71e3b350 (127.14.175.195:37253)
I20260809 01:57:55.312496 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:57:55.316035 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.314459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54336 (local address 127.14.175.254:38707)
0809 01:57:55.314589 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.314592 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.314725 (+ 133us) server_negotiation.cc:407] Connection header received
0809 01:57:55.314841 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.314843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.314873 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.314941 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.315675 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.315678 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.315680 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.315691 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.315708 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.315715 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.315786 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.315852 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.315891 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:57:55.318707 20010 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:57:55.322121 20010 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:57:55.334337 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.330822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:37533 (local address 127.0.0.1:39972)
0809 01:57:55.331258 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.331311 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.331427 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.332755 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.332761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.332838 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.333467 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.333469 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.333500 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.333556 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.333944 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.333954 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.333960 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.334091 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.334161 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":122,"threads_started":1}
I20260809 01:57:55.334633 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.331938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.14.175.193:37533)
0809 01:57:55.332295 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.332308 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.332333 (+ 25us) server_negotiation.cc:407] Connection header received
0809 01:57:55.332398 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.332402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.332595 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.332760 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.333689 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.333695 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.333706 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.333719 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.333795 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.333837 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.333954 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.334129 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.334211 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":105,"threads_started":1}
I20260809 01:57:55.335332 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.330933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:37253 (local address 127.0.0.1:52950)
0809 01:57:55.332300 (+ 1367us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.332341 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.332472 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.333565 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.333568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.333582 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.334596 (+ 1014us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.334599 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.334614 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.334641 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.335085 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.335087 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.335090 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.335167 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.335208 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1299,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260809 01:57:55.335409 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.331687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.14.175.195:37253)
0809 01:57:55.332206 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.332219 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.332454 (+ 235us) server_negotiation.cc:407] Connection header received
0809 01:57:55.332569 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.332580 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.332770 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.332949 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.334800 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.334806 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.334825 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.334837 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.334876 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.334903 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.335030 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.335195 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.335265 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":190,"threads_started":1}
I20260809 01:57:55.335503 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.331780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.14.175.194:44623)
0809 01:57:55.332274 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.332287 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.332840 (+ 553us) server_negotiation.cc:407] Connection header received
0809 01:57:55.332901 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.332907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.333060 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.333177 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.334801 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.334806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.334817 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.334830 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.334873 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.334903 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.335030 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.335268 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.335346 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":139,"threads_started":1}
I20260809 01:57:55.335743 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.331619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44623 (local address 127.0.0.1:51906)
0809 01:57:55.332668 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.332680 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.332746 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.334157 (+ 1411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.334160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.334172 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.334631 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.334633 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.334640 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.334655 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.335077 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.335080 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.335084 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.335161 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.335200 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"thread_start_us":101,"threads_started":1}
I20260809 01:57:55.337608 20141 tablet_service.cc:1467] Processing CreateTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 (DEFAULT_TABLE table=test-table [id=435d1159593645708837c1c47893e004]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:55.338248 20282 tablet_service.cc:1467] Processing CreateTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 (DEFAULT_TABLE table=test-table [id=435d1159593645708837c1c47893e004]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:55.338764 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9623e1d1c5b14a73a892f4d4c92d4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:55.339289 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9623e1d1c5b14a73a892f4d4c92d4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:55.344726 20423 tablet_service.cc:1467] Processing CreateTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 (DEFAULT_TABLE table=test-table [id=435d1159593645708837c1c47893e004]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:57:55.345574 20512 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Bootstrap starting.
I20260809 01:57:55.345775 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9623e1d1c5b14a73a892f4d4c92d4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:55.346210 20513 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Bootstrap starting.
I20260809 01:57:55.348390 20513 tablet_bootstrap.cc:654] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:55.348731 20512 tablet_bootstrap.cc:654] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:55.349421 20513 log.cc:824] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:55.349525 20512 log.cc:824] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:55.351687 20512 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: No bootstrap required, opened a new log
I20260809 01:57:55.351876 20513 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: No bootstrap required, opened a new log
I20260809 01:57:55.352006 20512 ts_tablet_manager.cc:1397] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260809 01:57:55.352077 20513 ts_tablet_manager.cc:1397] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 01:57:55.354655 20516 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Bootstrap starting.
I20260809 01:57:55.356664 20516 tablet_bootstrap.cc:654] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:55.357404 20516 log.cc:824] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:55.357218 20512 raft_consensus.cc:348] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.357496 20512 raft_consensus.cc:374] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:55.357590 20512 raft_consensus.cc:729] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea9dc584f1c46f5837327f34c8a2620, State: Initialized, Role: FOLLOWER
I20260809 01:57:55.358119 20512 consensus_queue.cc:260] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.358054 20513 raft_consensus.cc:348] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.358284 20513 raft_consensus.cc:374] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:55.358384 20513 raft_consensus.cc:729] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9504f909af4a4c57b2d1789b6c048916, State: Initialized, Role: FOLLOWER
I20260809 01:57:55.358816 20215 heartbeater.cc:503] Master 127.14.175.254:38707 was elected leader, sending a full tablet report...
I20260809 01:57:55.358879 20513 consensus_queue.cc:260] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.359251 20512 ts_tablet_manager.cc:1428] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Time spent starting tablet: real 0.007s user 0.001s sys 0.006s
I20260809 01:57:55.359542 20516 tablet_bootstrap.cc:492] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: No bootstrap required, opened a new log
I20260809 01:57:55.359724 20516 ts_tablet_manager.cc:1397] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 01:57:55.360164 20513 ts_tablet_manager.cc:1428] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260809 01:57:55.360522 20353 heartbeater.cc:503] Master 127.14.175.254:38707 was elected leader, sending a full tablet report...
I20260809 01:57:55.364373 20516 raft_consensus.cc:348] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.364619 20516 raft_consensus.cc:374] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:55.364656 20516 raft_consensus.cc:729] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb30304b665840338998f59c71e3b350, State: Initialized, Role: FOLLOWER
I20260809 01:57:55.364970 20516 consensus_queue.cc:260] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.365531 20495 heartbeater.cc:503] Master 127.14.175.254:38707 was elected leader, sending a full tablet report...
I20260809 01:57:55.365806 20516 ts_tablet_manager.cc:1428] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 01:57:55.372705 20354 tablet.cc:2369] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:55.414372 20519 raft_consensus.cc:482] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:57:55.414598 20519 raft_consensus.cc:504] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.415834 20519 leader_election.cc:288] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea9dc584f1c46f5837327f34c8a2620 (127.14.175.193:37533), bb30304b665840338998f59c71e3b350 (127.14.175.195:37253)
I20260809 01:57:55.417976 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.416258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:51383 (local address 127.14.175.195:37253)
0809 01:57:55.416428 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.416433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.416449 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:57:55.416496 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.416499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.416539 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.416632 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.417468 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.417472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.417474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.417484 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.417505 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.417514 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.417631 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.417788 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.417837 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 01:57:55.417977 20355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.416103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:37253 (local address 127.14.175.194:51383)
0809 01:57:55.416215 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.416231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.416337 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.416682 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.416685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.416701 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.417266 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.417270 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.417286 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.417318 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.417649 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.417656 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.417662 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.417754 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.417787 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 01:57:55.418362 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.416191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:42195 (local address 127.14.175.193:37533)
0809 01:57:55.416377 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.416382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.416925 (+ 543us) server_negotiation.cc:407] Connection header received
0809 01:57:55.417002 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.417007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.417045 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.417128 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.417923 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.417926 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.417929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.417941 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.417962 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.417971 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.418069 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.418187 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.418232 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:57:55.418387 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.416115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:37533 (local address 127.14.175.194:42195)
0809 01:57:55.416813 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.416828 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.416927 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.417170 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.417172 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.417184 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:55.417736 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:57:55.417740 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:55.417753 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:57:55.417781 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:55.418073 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:55.418077 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:55.418080 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 01:57:55.418176 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 01:57:55.418218 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":297,"thread_start_us":140,"threads_started":1}
I20260809 01:57:55.418738 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9623e1d1c5b14a73a892f4d4c92d4f87" candidate_uuid: "9504f909af4a4c57b2d1789b6c048916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb30304b665840338998f59c71e3b350" is_pre_election: true
I20260809 01:57:55.419018 20444 raft_consensus.cc:2454] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9504f909af4a4c57b2d1789b6c048916 in term 0.
I20260809 01:57:55.419513 20235 leader_election.cc:302] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9504f909af4a4c57b2d1789b6c048916, bb30304b665840338998f59c71e3b350; no voters:
I20260809 01:57:55.419669 20165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9623e1d1c5b14a73a892f4d4c92d4f87" candidate_uuid: "9504f909af4a4c57b2d1789b6c048916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea9dc584f1c46f5837327f34c8a2620" is_pre_election: true
I20260809 01:57:55.419811 20519 raft_consensus.cc:2781] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:57:55.419905 20519 raft_consensus.cc:482] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:57:55.419960 20519 raft_consensus.cc:3037] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:55.419996 20165 raft_consensus.cc:2454] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9504f909af4a4c57b2d1789b6c048916 in term 0.
W20260809 01:57:55.442901 20216 tablet.cc:2369] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:57:55.449844 20519 raft_consensus.cc:504] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.450420 20519 leader_election.cc:288] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [CANDIDATE]: Term 1 election: Requested vote from peers fea9dc584f1c46f5837327f34c8a2620 (127.14.175.193:37533), bb30304b665840338998f59c71e3b350 (127.14.175.195:37253)
I20260809 01:57:55.451037 20165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9623e1d1c5b14a73a892f4d4c92d4f87" candidate_uuid: "9504f909af4a4c57b2d1789b6c048916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea9dc584f1c46f5837327f34c8a2620"
I20260809 01:57:55.451100 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9623e1d1c5b14a73a892f4d4c92d4f87" candidate_uuid: "9504f909af4a4c57b2d1789b6c048916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb30304b665840338998f59c71e3b350"
I20260809 01:57:55.451200 20165 raft_consensus.cc:3037] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:55.451247 20444 raft_consensus.cc:3037] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:55.452512 20444 raft_consensus.cc:2454] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9504f909af4a4c57b2d1789b6c048916 in term 1.
I20260809 01:57:55.452889 20235 leader_election.cc:302] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9504f909af4a4c57b2d1789b6c048916, bb30304b665840338998f59c71e3b350; no voters:
I20260809 01:57:55.452957 20165 raft_consensus.cc:2454] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9504f909af4a4c57b2d1789b6c048916 in term 1.
I20260809 01:57:55.453094 20519 raft_consensus.cc:2781] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:55.453390 20519 raft_consensus.cc:686] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 1 LEADER]: Becoming Leader. State: Replica: 9504f909af4a4c57b2d1789b6c048916, State: Running, Role: LEADER
I20260809 01:57:55.453821 20519 consensus_queue.cc:237] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } }
I20260809 01:57:55.457352 20011 catalog_manager.cc:5495] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9504f909af4a4c57b2d1789b6c048916 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "9504f909af4a4c57b2d1789b6c048916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9504f909af4a4c57b2d1789b6c048916" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260809 01:57:55.487737 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.486203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.14.175.194:44623)
0809 01:57:55.486336 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.486340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.486354 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:57:55.486541 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.486544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.486606 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.486683 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.487299 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.487302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.487304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.487315 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.487335 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.487343 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.487420 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.487529 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.487564 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 01:57:55.493626 20444 raft_consensus.cc:1261] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 1 FOLLOWER]: Refusing update from remote peer 9504f909af4a4c57b2d1789b6c048916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:55.493626 20165 raft_consensus.cc:1261] T 9623e1d1c5b14a73a892f4d4c92d4f87 P fea9dc584f1c46f5837327f34c8a2620 [term 1 FOLLOWER]: Refusing update from remote peer 9504f909af4a4c57b2d1789b6c048916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:57:55.494395 20523 consensus_queue.cc:1035] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb30304b665840338998f59c71e3b350" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:55.494623 20519 consensus_queue.cc:1035] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea9dc584f1c46f5837327f34c8a2620" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:57:55.502414 20527 mvcc.cc:205] Tried to move back new op lower bound from 7316441806814588928 to 7316441806662131712. Current Snapshot: MvccSnapshot[applied={T|T < 7316441806814588928}]
I20260809 01:57:55.511233 20010 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:55.511394 20010 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:57:55.513895 20010 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ae0b3c786b5542baa9adac19441e05b1: Sending DeleteTablet for 3 replicas of tablet 9623e1d1c5b14a73a892f4d4c92d4f87
I20260809 01:57:55.514827 20141 tablet_service.cc:1514] Processing DeleteTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:55 UTC) from {username='slave'} at 127.0.0.1:39972
I20260809 01:57:55.514895 20423 tablet_service.cc:1514] Processing DeleteTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:55 UTC) from {username='slave'} at 127.0.0.1:52950
I20260809 01:57:55.515354 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20075
I20260809 01:57:55.515569 20282 tablet_service.cc:1514] Processing DeleteTablet for tablet 9623e1d1c5b14a73a892f4d4c92d4f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:57:55 UTC) from {username='slave'} at 127.0.0.1:51906
I20260809 01:57:55.518443 20538 tablet_replica.cc:330] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: stopping tablet replica
I20260809 01:57:55.518815 20538 raft_consensus.cc:2229] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:57:55.519412 20538 raft_consensus.cc:2258] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:57:55.521183 20538 ts_tablet_manager.cc:1905] T 9623e1d1c5b14a73a892f4d4c92d4f87 P bb30304b665840338998f59c71e3b350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:55.523212 20539 tablet_replica.cc:330] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: stopping tablet replica
I20260809 01:57:55.523540 20539 raft_consensus.cc:2229] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:57:55.523947 20539 raft_consensus.cc:2258] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 01:57:55.525286 19996 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:37533 (error 108)
I20260809 01:57:55.525461 20539 ts_tablet_manager.cc:1905] T 9623e1d1c5b14a73a892f4d4c92d4f87 P 9504f909af4a4c57b2d1789b6c048916: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:57:55.526252 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20218
I20260809 01:57:55.526432 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.526111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:37533 (local address 127.0.0.1:39978)
0809 01:57:55.526254 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.526339 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:37533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 01:57:55.527493 19996 catalog_manager.cc:4584] TS fea9dc584f1c46f5837327f34c8a2620 (127.14.175.193:37533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9623e1d1c5b14a73a892f4d4c92d4f87: Network error: Client connection negotiation failed: client connection to 127.14.175.193:37533: connect: Connection refused (error 111)
I20260809 01:57:55.534101 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20356
I20260809 01:57:55.536588 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.534252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44623 (local address 127.0.0.1:51926)
0809 01:57:55.536411 (+ 2159us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.536479 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.194:44623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2033}
I20260809 01:57:55.554318 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 19976
2026-08-09T01:57:55Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1038 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 01:57:55.578161 15039 mini_oidc.cc:152] Starting JWKS server
I20260809 01:57:55.580017 15039 webserver.cc:460] Webserver started at https://127.0.0.1:37577/ using document root <none> and password file <none>
I20260809 01:57:55.580199 15039 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 01:57:55.580495 15039 webserver.cc:460] Webserver started at http://127.0.0.1:46305/ using document root <none> and password file <none>
2026-08-09T01:57:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:55Z Disabled control of system clock
I20260809 01:57:55.590946 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43287
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:43287
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37577/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/testchainca.cert with env {}
W20260809 01:57:55.702390 20547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:55.702665 20547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:55.702705 20547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:55.706821 20547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:55.706889 20547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:55.706905 20547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:55.706923 20547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:55.706938 20547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 01:57:55.706954 20547 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 01:57:55.706983 20547 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37577/jwks.json
I20260809 01:57:55.712551 20547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:43287
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37577/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:55.713569 20547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:55.714517 20547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:55.723145 20553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:55.723310 20547 server_base.cc:1034] running on GCE node
W20260809 01:57:55.723162 20552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:55.723515 20555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:55.724081 20547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:55.725330 20547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:55.726519 20547 hybrid_clock.cc:648] HybridClock initialized: now 1786240675726491 us; error 43 us; skew 500 ppm
I20260809 01:57:55.728426 20547 webserver.cc:460] Webserver started at http://127.14.175.254:34041/ using document root <none> and password file <none>
I20260809 01:57:55.729019 20547 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:55.729115 20547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:55.729348 20547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:55.731462 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "bbdebcf4f0014dd6aba47f0f947dca07"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "d5fc487dd9f57469a74cc71e61452208"
server_key_iv: "52c4c9eae27b736fae7e43bab0984fe1"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.732036 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "bbdebcf4f0014dd6aba47f0f947dca07"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "d5fc487dd9f57469a74cc71e61452208"
server_key_iv: "52c4c9eae27b736fae7e43bab0984fe1"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.735734 20547 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:55.738149 20562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:55.739441 20547 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:55.739601 20547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "bbdebcf4f0014dd6aba47f0f947dca07"
format_stamp: "Formatted at 2026-08-09 01:57:55 on dist-test-slave-2w3w"
server_key: "d5fc487dd9f57469a74cc71e61452208"
server_key_iv: "52c4c9eae27b736fae7e43bab0984fe1"
server_key_version: "encryptionkey@0"
I20260809 01:57:55.739719 20547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:55.757810 20547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:55.758571 20547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:55.758793 20547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:55.766083 20547 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:43287
I20260809 01:57:55.766147 20621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:43287 every 8 connection(s)
I20260809 01:57:55.767146 20547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:55.770378 20622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:55.776007 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: Bootstrap starting.
I20260809 01:57:55.777463 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20547
I20260809 01:57:55.777591 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:55.777902 15039 external_mini_cluster.cc:1428] Setting key ffd66257f3df5e438d66ed344b6f0822
I20260809 01:57:55.778916 20622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:55.779801 20622 log.cc:824] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:55.781948 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: No bootstrap required, opened a new log
I20260809 01:57:55.786119 20622 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } }
I20260809 01:57:55.786375 20622 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:55.786465 20622 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbdebcf4f0014dd6aba47f0f947dca07, State: Initialized, Role: FOLLOWER
I20260809 01:57:55.786913 20622 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } }
I20260809 01:57:55.787140 20622 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:55.787231 20622 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:55.787353 20622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:55.787681 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.779010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41224 (local address 127.14.175.254:43287)
0809 01:57:55.779696 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.779711 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.779745 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:57:55.780663 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.780691 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.781083 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.781420 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:55.781861 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.782879 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.783864 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.784373 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.784556 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:55.785496 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:55.785501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:55.785516 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:55.785906 (+ 390us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:55.785963 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:55.785984 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:55.786109 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:55.786266 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 01:57:55.786611 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":155,"threads_started":1}
I20260809 01:57:55.790587 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 01:57:55.845140 20622 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } }
I20260809 01:57:55.845685 20622 leader_election.cc:302] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbdebcf4f0014dd6aba47f0f947dca07; no voters:
I20260809 01:57:55.846164 20622 leader_election.cc:288] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:55.846340 20627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:55.846633 20627 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [term 1 LEADER]: Becoming Leader. State: Replica: bbdebcf4f0014dd6aba47f0f947dca07, State: Running, Role: LEADER
I20260809 01:57:55.847081 20627 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } }
I20260809 01:57:55.847731 20622 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:55.848905 20628 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } } }
I20260809 01:57:55.849436 20628 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:55.849872 20629 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbdebcf4f0014dd6aba47f0f947dca07. Latest consensus state: current_term: 1 leader_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbdebcf4f0014dd6aba47f0f947dca07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43287 } } }
I20260809 01:57:55.850566 20629 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07 [sys.catalog]: This master's current role is: LEADER
W20260809 01:57:55.853183 20643 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:55.853278 20643 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:55.853369 20636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:55.854295 20636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:55.859929 20636 catalog_manager.cc:1347] Generated new cluster ID: 40d13ecd8f844c74a42631d99c08defc
I20260809 01:57:55.860011 20636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:55.884927 20636 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:55.885958 20636 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:55.892544 20636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbdebcf4f0014dd6aba47f0f947dca07: Generated new TSK 0
I20260809 01:57:55.893251 20636 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 01:57:55.930133 20654 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 01:57:55.930352 20654 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 01:57:55.930987 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:55.904180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41230 (local address 127.14.175.254:43287)
0809 01:57:55.904343 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:55.904348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:55.904568 (+ 220us) server_negotiation.cc:407] Connection header received
0809 01:57:55.904805 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:55.904807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:55.904854 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:55.904942 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0809 01:57:55.905219 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.905767 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.907066 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.907296 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.907380 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:55.907777 (+ 397us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 01:57:55.930324 (+ 22547us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 01:57:55.930801 (+ 477us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41230: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 01:57:55.931097 20625 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41230: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 01:57:55.932452 20653 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:55.904119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43287 (local address 127.0.0.1:41230)
0809 01:57:55.904488 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:55.904505 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:55.904637 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:55.904980 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:55.904983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:55.904992 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 01:57:55.905112 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:55.905118 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.905886 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.905890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:55.906879 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:55.906889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:55.907411 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:55.907415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:55.907507 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:55.907560 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 01:57:55.930696 (+ 23136us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 01:57:55.931003 (+ 307us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.175.254:43287: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":137,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.14.175.254:43287: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 01:57:55.933266 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20547
2026-08-09T01:57:55Z chronyd exiting
I20260809 01:57:55.972623 15039 test_util.cc:175] -----------------------------------------------
I20260809 01:57:55.972716 15039 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786240649484061-15039-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (396 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 01:57:55.973899 15039 mini_oidc.cc:152] Starting JWKS server
I20260809 01:57:55.974824 15039 webserver.cc:460] Webserver started at https://127.0.0.1:44251/ using document root <none> and password file <none>
I20260809 01:57:55.974939 15039 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 01:57:55.975263 15039 webserver.cc:460] Webserver started at http://127.0.0.1:45825/ using document root <none> and password file <none>
2026-08-09T01:57:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:55Z Disabled control of system clock
I20260809 01:57:55.985714 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41893
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:32821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:41893
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44251/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/testchainca.cert with env {}
W20260809 01:57:56.102408 20661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:56.102706 20661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:56.102751 20661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:56.106899 20661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:56.106990 20661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:56.107008 20661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:56.107026 20661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:56.107043 20661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 01:57:56.107059 20661 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 01:57:56.107076 20661 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44251/jwks.json
I20260809 01:57:56.112802 20661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:41893
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44251/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:56.113878 20661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:56.114871 20661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:56.123405 20667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:56.123399 20670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:56.123420 20668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:56.123828 20661 server_base.cc:1034] running on GCE node
I20260809 01:57:56.124434 20661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:56.125638 20661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:56.126816 20661 hybrid_clock.cc:648] HybridClock initialized: now 1786240676126782 us; error 49 us; skew 500 ppm
I20260809 01:57:56.128794 20661 webserver.cc:460] Webserver started at http://127.14.175.254:35117/ using document root <none> and password file <none>
I20260809 01:57:56.129380 20661 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:56.129496 20661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:56.129716 20661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:56.131843 20661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "1d0a519cc5d546e3aaa1bf7b126e671b"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "724eef85537dba2f42a4068e8285d871"
server_key_iv: "9efe845acd7be79eb1fcad00cfc1a6c6"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.132431 20661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "1d0a519cc5d546e3aaa1bf7b126e671b"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "724eef85537dba2f42a4068e8285d871"
server_key_iv: "9efe845acd7be79eb1fcad00cfc1a6c6"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.136232 20661 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 01:57:56.138646 20677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:56.139873 20661 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:57:56.140036 20661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "1d0a519cc5d546e3aaa1bf7b126e671b"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "724eef85537dba2f42a4068e8285d871"
server_key_iv: "9efe845acd7be79eb1fcad00cfc1a6c6"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.140174 20661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:56.157105 20661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:56.157816 20661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:56.158046 20661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:56.165850 20661 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:41893
I20260809 01:57:56.165859 20733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:41893 every 8 connection(s)
I20260809 01:57:56.166808 20661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:56.170064 20734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:56.172278 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20661
I20260809 01:57:56.172425 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:56.172734 15039 external_mini_cluster.cc:1428] Setting key 5864c5af79579005688e2ca4a8aff25b
I20260809 01:57:56.176414 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b: Bootstrap starting.
I20260809 01:57:56.178638 20734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:56.179584 20734 log.cc:824] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:56.181991 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b: No bootstrap required, opened a new log
I20260809 01:57:56.183028 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:56.174166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46986 (local address 127.14.175.254:41893)
0809 01:57:56.175006 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:56.175036 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:56.175084 (+ 48us) server_negotiation.cc:407] Connection header received
0809 01:57:56.175751 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:56.175776 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:56.176261 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:56.176607 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:56.177043 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.178093 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.179079 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.179800 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.179985 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.180925 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:56.180932 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:56.180947 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:56.181449 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:56.181530 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:56.181557 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:56.181661 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:56.181807 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 01:57:56.182077 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":139,"threads_started":1}
I20260809 01:57:56.186002 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 01:57:56.186331 20734 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } }
I20260809 01:57:56.186576 20734 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:56.186648 20734 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0a519cc5d546e3aaa1bf7b126e671b, State: Initialized, Role: FOLLOWER
I20260809 01:57:56.187165 20734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } }
I20260809 01:57:56.187335 20734 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:56.187405 20734 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:56.187502 20734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:56.245846 20734 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } }
I20260809 01:57:56.246402 20734 leader_election.cc:302] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d0a519cc5d546e3aaa1bf7b126e671b; no voters:
I20260809 01:57:56.246835 20734 leader_election.cc:288] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:56.247001 20740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:56.247267 20740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [term 1 LEADER]: Becoming Leader. State: Replica: 1d0a519cc5d546e3aaa1bf7b126e671b, State: Running, Role: LEADER
I20260809 01:57:56.247646 20740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } }
I20260809 01:57:56.248543 20734 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:56.249413 20741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } } }
I20260809 01:57:56.249564 20741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:56.249950 20742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0a519cc5d546e3aaa1bf7b126e671b. Latest consensus state: current_term: 1 leader_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d0a519cc5d546e3aaa1bf7b126e671b" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41893 } } }
I20260809 01:57:56.250113 20742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:56.250531 20746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:56.254048 20746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:56.260439 20746 catalog_manager.cc:1347] Generated new cluster ID: a4e5afc679b24fed9a05b289dc5a9c21
I20260809 01:57:56.260519 20746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:56.285560 20746 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:56.286589 20746 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:56.296605 20746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d0a519cc5d546e3aaa1bf7b126e671b: Generated new TSK 0
I20260809 01:57:56.297333 20746 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 01:57:56.336133 20769 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 01:57:56.336239 20769 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 01:57:56.337038 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:56.316147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.14.175.254:41893)
0809 01:57:56.316299 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:56.316304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:56.316484 (+ 180us) server_negotiation.cc:407] Connection header received
0809 01:57:56.316665 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:56.316668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:56.316716 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:56.316811 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0809 01:57:56.317086 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.317662 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.319117 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.319401 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.319525 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.319870 (+ 345us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 01:57:56.336550 (+ 16680us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 01:57:56.336852 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47000: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 01:57:56.337126 20738 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47000: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 01:57:56.337188 20768 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:56.316058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41893 (local address 127.0.0.1:47000)
0809 01:57:56.316386 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:56.316401 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:56.316530 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:56.316834 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:56.316837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:56.316846 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 01:57:56.316972 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:56.316978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.317799 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.317803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:56.318950 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:56.318992 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.319540 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.319544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:56.319637 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.319669 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 01:57:56.336807 (+ 17138us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 01:57:56.336990 (+ 183us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.175.254:41893: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":114,"threads_started":1}
I20260809 01:57:56.337855 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20661
2026-08-09T01:57:56Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (405 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 01:57:56.379743 15039 mini_oidc.cc:152] Starting JWKS server
I20260809 01:57:56.380654 15039 webserver.cc:460] Webserver started at https://127.0.0.1:40989/ using document root <none> and password file <none>
I20260809 01:57:56.380739 15039 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 01:57:56.380996 15039 webserver.cc:460] Webserver started at http://127.0.0.1:39927/ using document root <none> and password file <none>
2026-08-09T01:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:56Z Disabled control of system clock
I20260809 01:57:56.391057 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37683
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:35541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:37683
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40989/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 01:57:56.504868 20775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:56.505162 20775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:56.505200 20775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:56.509289 20775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:56.509351 20775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:56.509366 20775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:56.509383 20775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:56.509399 20775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 01:57:56.509455 20775 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 01:57:56.509482 20775 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40989/jwks.json
I20260809 01:57:56.514778 20775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:37683
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40989/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:56.515933 20775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:56.517318 20775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:56.526325 20781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:56.526489 20784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:56.526376 20775 server_base.cc:1034] running on GCE node
W20260809 01:57:56.526325 20780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:56.527263 20775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:56.528360 20775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:56.529533 20775 hybrid_clock.cc:648] HybridClock initialized: now 1786240676529519 us; error 29 us; skew 500 ppm
I20260809 01:57:56.531636 20775 webserver.cc:460] Webserver started at http://127.14.175.254:33253/ using document root <none> and password file <none>
I20260809 01:57:56.532236 20775 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:56.532305 20775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:56.532562 20775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:56.534644 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "19cf134ae8e647949c1890398e0a110c"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "b3806b513aac0006bd940b3163cd90a9"
server_key_iv: "24bbe0fa77870e20400946641bf3f55f"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.535251 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "19cf134ae8e647949c1890398e0a110c"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "b3806b513aac0006bd940b3163cd90a9"
server_key_iv: "24bbe0fa77870e20400946641bf3f55f"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.539057 20775 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 01:57:56.541457 20791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:56.542683 20775 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 01:57:56.542819 20775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "19cf134ae8e647949c1890398e0a110c"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "b3806b513aac0006bd940b3163cd90a9"
server_key_iv: "24bbe0fa77870e20400946641bf3f55f"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.542935 20775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:56.566883 20775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:56.567691 20775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:56.567903 20775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:56.575203 20775 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:37683
I20260809 01:57:56.575227 20846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:37683 every 8 connection(s)
I20260809 01:57:56.576152 20775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:56.577533 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20775
I20260809 01:57:56.577675 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:56.578025 15039 external_mini_cluster.cc:1428] Setting key 99aa417b10862a2c97be211b49e7ba83
I20260809 01:57:56.579924 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:56.586625 20847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: Bootstrap starting.
I20260809 01:57:56.587361 20850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:56.579406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.14.175.254:37683)
0809 01:57:56.580076 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:56.580093 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:56.580131 (+ 38us) server_negotiation.cc:407] Connection header received
0809 01:57:56.580774 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:56.580788 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:56.581194 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:56.581467 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:56.581833 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.582814 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.584050 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.584520 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.584639 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.585520 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:56.585524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:56.585537 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:56.585916 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:56.585970 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:56.585990 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:56.586075 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:56.586246 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 01:57:56.586555 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":141,"threads_started":1}
I20260809 01:57:56.589133 20847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:56.590006 20847 log.cc:824] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:56.590298 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 01:57:56.592259 20847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: No bootstrap required, opened a new log
I20260809 01:57:56.595862 20847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } }
I20260809 01:57:56.596131 20847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:56.596191 20847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19cf134ae8e647949c1890398e0a110c, State: Initialized, Role: FOLLOWER
I20260809 01:57:56.596580 20847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } }
I20260809 01:57:56.596695 20847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:56.596740 20847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:56.596810 20847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:56.661545 20847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } }
I20260809 01:57:56.662073 20847 leader_election.cc:302] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19cf134ae8e647949c1890398e0a110c; no voters:
I20260809 01:57:56.662472 20847 leader_election.cc:288] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:56.662647 20852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:56.662902 20852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [term 1 LEADER]: Becoming Leader. State: Replica: 19cf134ae8e647949c1890398e0a110c, State: Running, Role: LEADER
I20260809 01:57:56.663326 20852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } }
I20260809 01:57:56.663931 20847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:56.665102 20853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19cf134ae8e647949c1890398e0a110c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } } }
I20260809 01:57:56.665284 20853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:56.665697 20854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19cf134ae8e647949c1890398e0a110c. Latest consensus state: current_term: 1 leader_uuid: "19cf134ae8e647949c1890398e0a110c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cf134ae8e647949c1890398e0a110c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37683 } } }
I20260809 01:57:56.665819 20854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c [sys.catalog]: This master's current role is: LEADER
W20260809 01:57:56.669049 20869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:57:56.669157 20869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:57:56.669235 20862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:56.669938 20862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:56.676295 20862 catalog_manager.cc:1347] Generated new cluster ID: 94455b72ba834ad6a27d49525606d09d
I20260809 01:57:56.676388 20862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:56.696049 20862 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:56.697067 20862 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:56.712539 20862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19cf134ae8e647949c1890398e0a110c: Generated new TSK 0
I20260809 01:57:56.713292 20862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:57:56.740098 20850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:56.734456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35834 (local address 127.14.175.254:37683)
0809 01:57:56.734608 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:56.734613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:56.734858 (+ 245us) server_negotiation.cc:407] Connection header received
0809 01:57:56.735045 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:56.735047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:56.735096 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:56.735192 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0809 01:57:56.735436 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.735933 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.737170 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.737391 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.737471 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.737789 (+ 318us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 01:57:56.739712 (+ 1923us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40989/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 01:57:56.739947 (+ 235us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35834: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40989/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 01:57:56.740171 20850 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35834: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40989/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 01:57:56.741680 20881 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:56.734359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37683 (local address 127.0.0.1:35834)
0809 01:57:56.734729 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:56.734744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:56.734874 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:56.735212 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:56.735215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:56.735224 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 01:57:56.735339 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:56.735344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.736079 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.736082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:56.737061 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:56.737071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.737521 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.737525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:56.737605 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.737631 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 01:57:56.739884 (+ 2253us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40989/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 01:57:56.741505 (+ 1621us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.175.254:37683: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40989/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":1413,"thread_start_us":141,"threads_started":1}
I20260809 01:57:56.742249 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20775
E20260809 01:57:56.751792 20882 webserver.cc:533] Webserver: sslize failed:
E20260809 01:57:56.751878 20882 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T01:57:56Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (403 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T01:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:56Z Disabled control of system clock
I20260809 01:57:56.792456 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40715
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:40571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40715
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/testchainca.cert with env {}
W20260809 01:57:56.901185 20886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:56.901471 20886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:56.901511 20886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:56.905423 20886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:56.905481 20886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:56.905496 20886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:56.905514 20886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:56.905529 20886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 01:57:56.905544 20886 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 01:57:56.905557 20886 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 01:57:56.910820 20886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40715
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:56.911819 20886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:56.912791 20886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:56.921146 20892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:56.921147 20895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:56.921268 20886 server_base.cc:1034] running on GCE node
W20260809 01:57:56.921140 20893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:56.922003 20886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:56.923054 20886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:56.924214 20886 hybrid_clock.cc:648] HybridClock initialized: now 1786240676924190 us; error 38 us; skew 500 ppm
I20260809 01:57:56.926282 20886 webserver.cc:460] Webserver started at http://127.14.175.254:46597/ using document root <none> and password file <none>
I20260809 01:57:56.926923 20886 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:56.927053 20886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:56.927268 20886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:56.929243 20886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "1445e8cddd1a4d6380fda70d43bbca5d"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "3fd2a38a1c8d3553516e0e470995c688"
server_key_iv: "cb6cfcc39072eed79d0b6b97cca82ff0"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.929805 20886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "1445e8cddd1a4d6380fda70d43bbca5d"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "3fd2a38a1c8d3553516e0e470995c688"
server_key_iv: "cb6cfcc39072eed79d0b6b97cca82ff0"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.933408 20886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:56.936002 20902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:56.937248 20886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:56.937379 20886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "1445e8cddd1a4d6380fda70d43bbca5d"
format_stamp: "Formatted at 2026-08-09 01:57:56 on dist-test-slave-2w3w"
server_key: "3fd2a38a1c8d3553516e0e470995c688"
server_key_iv: "cb6cfcc39072eed79d0b6b97cca82ff0"
server_key_version: "encryptionkey@0"
I20260809 01:57:56.937484 20886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:56.959923 20886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:56.960639 20886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:56.960839 20886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:56.968429 20886 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40715
I20260809 01:57:56.968456 20957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40715 every 8 connection(s)
I20260809 01:57:56.969388 20886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:56.972544 20958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:56.977972 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d: Bootstrap starting.
I20260809 01:57:56.978327 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 20886
I20260809 01:57:56.978453 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:56.978721 15039 external_mini_cluster.cc:1428] Setting key 15f889a036a71f797b44246d23bfeca2
I20260809 01:57:56.980603 20958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:56.981345 20958 log.cc:824] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:56.983471 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d: No bootstrap required, opened a new log
I20260809 01:57:56.987800 20958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } }
I20260809 01:57:56.988034 20958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:56.988121 20958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1445e8cddd1a4d6380fda70d43bbca5d, State: Initialized, Role: FOLLOWER
I20260809 01:57:56.988375 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:56.980139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60652 (local address 127.14.175.254:40715)
0809 01:57:56.980769 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:56.980784 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:56.980820 (+ 36us) server_negotiation.cc:407] Connection header received
0809 01:57:56.981423 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:56.981438 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:56.981919 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:56.982258 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:56.982590 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.983661 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.984888 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:56.985348 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:56.985474 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:56.986387 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:56.986392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:56.986403 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:57:56.986770 (+ 367us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:56.986823 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:57:56.986841 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:56.986927 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:56.987143 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 01:57:56.987529 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":136,"threads_started":1}
I20260809 01:57:56.988607 20958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } }
I20260809 01:57:56.988767 20958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:56.988834 20958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:56.988940 20958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:56.989944 20958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } }
I20260809 01:57:56.990290 20958 leader_election.cc:302] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1445e8cddd1a4d6380fda70d43bbca5d; no voters:
I20260809 01:57:56.990671 20958 leader_election.cc:288] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:56.990754 20964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:56.990988 20964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [term 1 LEADER]: Becoming Leader. State: Replica: 1445e8cddd1a4d6380fda70d43bbca5d, State: Running, Role: LEADER
I20260809 01:57:56.991307 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 01:57:56.991281 20964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } }
I20260809 01:57:56.991989 20958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:56.992772 20965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } } }
I20260809 01:57:56.992908 20965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:56.993201 20966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1445e8cddd1a4d6380fda70d43bbca5d. Latest consensus state: current_term: 1 leader_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1445e8cddd1a4d6380fda70d43bbca5d" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40715 } } }
I20260809 01:57:56.993314 20966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:56.993561 20973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:56.996706 20973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:57.001734 20973 catalog_manager.cc:1347] Generated new cluster ID: 01696ae59bce4aa3bf47d209b978f5c7
I20260809 01:57:57.001924 20973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:57.018226 20973 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:57.019214 20973 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:57.024096 20973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1445e8cddd1a4d6380fda70d43bbca5d: Generated new TSK 0
I20260809 01:57:57.024739 20973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:57:57.112618 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:57.037172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.14.175.254:40715)
0809 01:57:57.037312 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:57.037317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:57.037524 (+ 207us) server_negotiation.cc:407] Connection header received
0809 01:57:57.037674 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:57.037676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:57.037728 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:57.037859 (+ 131us) server_negotiation.cc:226] Negotiated authn=JWT
0809 01:57:57.038110 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:57.038670 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:57.039942 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:57.040161 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:57.040244 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:57.040606 (+ 362us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 01:57:57.112219 (+ 71613us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 01:57:57.112475 (+ 256us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60660: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 01:57:57.112727 20962 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60660: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 01:57:57.112910 20990 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:57.037121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40715 (local address 127.0.0.1:60660)
0809 01:57:57.037434 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:57.037449 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:57.037562 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:57.037877 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:57.037880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:57.037888 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 01:57:57.037999 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:57.038005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:57.038777 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:57.038781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:57.039807 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:57.039817 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:57.040299 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:57.040303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:57.040399 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:57.040428 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 01:57:57.112475 (+ 72047us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 01:57:57.112708 (+ 233us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.175.254:40715: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":132,"threads_started":1}
I20260809 01:57:57.113600 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 20886
2026-08-09T01:57:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (350 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (123 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (123 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:57 dist-test-slave-2w3w krb5kdc[21002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:57 dist-test-slave-2w3w krb5kdc[21002](info): set up 2 sockets
Aug 09 01:57:57 dist-test-slave-2w3w krb5kdc[21002](info): commencing operation
krb5kdc: starting...
W20260809 01:57:58.439733 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:57:58 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:57:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:57:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:57:58.566329 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41949
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:41949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:58.674759 21015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:58.675124 21015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:58.675215 21015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:58.679149 21015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:57:58.679231 21015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:58.679270 21015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:58.679301 21015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:57:58.679338 21015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:57:58.684537 21015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:41949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:58.685612 21015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:58.686652 21015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:58.695087 21021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:58.695101 21024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:58.695087 21022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:58.695436 21015 server_base.cc:1034] running on GCE node
I20260809 01:57:58.695945 21015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:58.696931 21015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:58.698088 21015 hybrid_clock.cc:648] HybridClock initialized: now 1786240678698076 us; error 24 us; skew 500 ppm
Aug 09 01:57:58 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240678, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:58.705284 21015 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:57:58.706156 21015 webserver.cc:460] Webserver started at http://127.14.175.254:38725/ using document root <none> and password file <none>
I20260809 01:57:58.706661 21015 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:58.706717 21015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:58.706879 21015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:58.708892 21015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "8d6239191ea4414fbe4e9541787a8399"
format_stamp: "Formatted at 2026-08-09 01:57:58 on dist-test-slave-2w3w"
server_key: "12230217ba2eff761400cf4010b4c3dc"
server_key_iv: "4e2e1f86f2093bff5439174754855486"
server_key_version: "encryptionkey@0"
I20260809 01:57:58.709408 21015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "8d6239191ea4414fbe4e9541787a8399"
format_stamp: "Formatted at 2026-08-09 01:57:58 on dist-test-slave-2w3w"
server_key: "12230217ba2eff761400cf4010b4c3dc"
server_key_iv: "4e2e1f86f2093bff5439174754855486"
server_key_version: "encryptionkey@0"
I20260809 01:57:58.712972 21015 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:57:58.716041 21033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:58.717713 21015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 01:57:58.717842 21015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "8d6239191ea4414fbe4e9541787a8399"
format_stamp: "Formatted at 2026-08-09 01:57:58 on dist-test-slave-2w3w"
server_key: "12230217ba2eff761400cf4010b4c3dc"
server_key_iv: "4e2e1f86f2093bff5439174754855486"
server_key_version: "encryptionkey@0"
I20260809 01:57:58.717979 21015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:58.750656 21015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:58.753778 21015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:58.754015 21015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:58.761183 21015 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:41949
I20260809 01:57:58.761209 21087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:41949 every 8 connection(s)
I20260809 01:57:58.762121 21015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:57:58.763338 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21015
I20260809 01:57:58.763475 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:57:58.763780 15039 external_mini_cluster.cc:1428] Setting key 3809283d9004d55c3e2ae56a3a9ee9f6
I20260809 01:57:58.765410 21088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:57:58.770782 21088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399: Bootstrap starting.
Aug 09 01:57:58 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:58.773043 21088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399: Neither blocks nor log segments found. Creating new log.
I20260809 01:57:58.773980 21088 log.cc:824] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399: Log is configured to *not* fsync() on all Append() calls
I20260809 01:57:58.776201 21088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399: No bootstrap required, opened a new log
I20260809 01:57:58.778082 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:58.765274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46366 (local address 127.14.175.254:41949)
0809 01:57:58.765740 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:58.765755 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:58.765807 (+ 52us) server_negotiation.cc:407] Connection header received
0809 01:57:58.766430 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:58.766446 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:58.766768 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:58.767123 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:58.767917 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:58.768864 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:58.769686 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:58.770150 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:58.770327 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:58.772835 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:58.772841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:58.772855 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:58.772888 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:58.774707 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:58.775230 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:58.775235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:58.775240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:58.775377 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:58.775668 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:58.775671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:58.775673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:58.776162 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:58.776357 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:58.776624 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 01:57:58.776919 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":133,"threads_started":1}
I20260809 01:57:58.779901 21088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } }
I20260809 01:57:58.780179 21088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:57:58.780241 21088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6239191ea4414fbe4e9541787a8399, State: Initialized, Role: FOLLOWER
I20260809 01:57:58.780697 21088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } }
I20260809 01:57:58.780840 21088 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:57:58.780905 21088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:57:58.780997 21088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:57:58.782042 21088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } }
I20260809 01:57:58.782374 21088 leader_election.cc:302] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d6239191ea4414fbe4e9541787a8399; no voters:
I20260809 01:57:58.782660 21088 leader_election.cc:288] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:57:58.782786 21093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:57:58.783031 21093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [term 1 LEADER]: Becoming Leader. State: Replica: 8d6239191ea4414fbe4e9541787a8399, State: Running, Role: LEADER
I20260809 01:57:58.783365 21093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } }
I20260809 01:57:58.783859 21088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:57:58.784955 21094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d6239191ea4414fbe4e9541787a8399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } } }
I20260809 01:57:58.785094 21094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:58.785429 21095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d6239191ea4414fbe4e9541787a8399. Latest consensus state: current_term: 1 leader_uuid: "8d6239191ea4414fbe4e9541787a8399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6239191ea4414fbe4e9541787a8399" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41949 } } }
I20260809 01:57:58.785540 21095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399 [sys.catalog]: This master's current role is: LEADER
I20260809 01:57:58.786259 21103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:57:58.789029 21103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:57:58.794261 21103 catalog_manager.cc:1347] Generated new cluster ID: 41f2283819c34b25846835af41203ac4
I20260809 01:57:58.794329 21103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:57:58.827965 21103 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:57:58.828935 21103 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:57:58.835287 21103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d6239191ea4414fbe4e9541787a8399: Generated new TSK 0
I20260809 01:57:58.835965 21103 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:57:58.866465 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:58.980302 21115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:58.980552 21115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:58.980630 21115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:58.984802 21115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:58.984863 21115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:58.984957 21115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:57:58.990249 21115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:58.991307 21115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:58.992303 21115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:59.001816 21121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:59.001816 21122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:59.001976 21115 server_base.cc:1034] running on GCE node
W20260809 01:57:59.001888 21124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:59.002429 21115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:59.003070 21115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:59.004261 21115 hybrid_clock.cc:648] HybridClock initialized: now 1786240679004231 us; error 44 us; skew 500 ppm
Aug 09 01:57:58 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240678, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.007162 21115 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:57:59.007988 21115 webserver.cc:460] Webserver started at http://127.14.175.193:41585/ using document root <none> and password file <none>
I20260809 01:57:59.008491 21115 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:59.008554 21115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:59.008713 21115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:59.010632 21115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "c3d08f4f058e4467850606e456cb1400"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "2e05053a7ab6c52d52178f39fdfe8b4f"
server_key_iv: "4ae626b7586b71c4adb5bb045132830e"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.011229 21115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "c3d08f4f058e4467850606e456cb1400"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "2e05053a7ab6c52d52178f39fdfe8b4f"
server_key_iv: "4ae626b7586b71c4adb5bb045132830e"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.014832 21115 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:57:59.017235 21131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.018420 21115 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:57:59.018515 21115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "c3d08f4f058e4467850606e456cb1400"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "2e05053a7ab6c52d52178f39fdfe8b4f"
server_key_iv: "4ae626b7586b71c4adb5bb045132830e"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.018595 21115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:59.029580 21115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:59.033015 21115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:59.033172 21115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:59.033700 21115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:59.034471 21115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:59.034519 21115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.034559 21115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:59.034581 21115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.043457 21115 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:40169
I20260809 01:57:59.043488 21252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:40169 every 8 connection(s)
I20260809 01:57:59.044338 21115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:57:59.045655 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21115
I20260809 01:57:59.045805 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:57:59.046155 15039 external_mini_cluster.cc:1428] Setting key 042f2f10509cef07783da513d7d4a165
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240678, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:57:59.062462 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.047138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:53965 (local address 127.14.175.254:41949)
0809 01:57:59.047320 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.047325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.049096 (+ 1771us) server_negotiation.cc:407] Connection header received
0809 01:57:59.051039 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.051045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.051111 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.051203 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.053051 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.053886 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.055153 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.055412 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.055533 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.058725 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.058729 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.058731 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.058762 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.060341 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.060853 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.060858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.060860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.060946 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.061293 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.061297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.061299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.061509 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.061620 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.062129 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.062275 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 01:57:59.063371 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.047194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41949 (local address 127.14.175.193:53965)
0809 01:57:59.048912 (+ 1718us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:59.048992 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:59.050739 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:59.051420 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:59.051430 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:59.051976 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:59.052663 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.052685 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.054027 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.054031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.054960 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.055034 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.055571 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.055575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.055784 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.056532 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:59.056553 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:59.058549 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:59.060466 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.060472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.060487 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.060749 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.061044 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.061047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.061049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.061196 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.061618 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:59.061626 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:59.061883 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 01:57:59.062086 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 01:57:59.062425 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1479,"thread_start_us":160,"threads_started":1}
I20260809 01:57:59.064739 21254 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41949
I20260809 01:57:59.064988 21254 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:59.065492 21254 heartbeater.cc:511] Master 127.14.175.254:41949 requested a full tablet report, sending...
I20260809 01:57:59.067219 21051 ts_manager.cc:194] Registered new tserver with Master: c3d08f4f058e4467850606e456cb1400 (127.14.175.193:40169)
I20260809 01:57:59.068858 21051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:53965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:57:59.077688 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:59.187171 21259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:59.187409 21259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:59.187449 21259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:59.191288 21259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:59.191334 21259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:59.191392 21259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:57:59.196242 21259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:59.197094 21259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:59.198097 21259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:59.207211 21264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:59.207233 21265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:59.207211 21267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:59.207432 21259 server_base.cc:1034] running on GCE node
I20260809 01:57:59.207840 21259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:59.208418 21259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:59.209570 21259 hybrid_clock.cc:648] HybridClock initialized: now 1786240679209558 us; error 28 us; skew 500 ppm
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.212533 21259 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:57:59.213392 21259 webserver.cc:460] Webserver started at http://127.14.175.194:37311/ using document root <none> and password file <none>
I20260809 01:57:59.214093 21259 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:59.214187 21259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:59.214407 21259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:59.216545 21259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "5013de83dc6a4e8aa823a78a2a85de76"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "28e531624befd655e1adec14d396491e"
server_key_iv: "fca490ff0424e314793a9a63646ecca7"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.217141 21259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "5013de83dc6a4e8aa823a78a2a85de76"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "28e531624befd655e1adec14d396491e"
server_key_iv: "fca490ff0424e314793a9a63646ecca7"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.220937 21259 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 01:57:59.223425 21274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.224629 21259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:57:59.224756 21259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "5013de83dc6a4e8aa823a78a2a85de76"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "28e531624befd655e1adec14d396491e"
server_key_iv: "fca490ff0424e314793a9a63646ecca7"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.224892 21259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:59.236749 21259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:59.239403 21259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:59.239585 21259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:59.240136 21259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:59.240901 21259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:59.240972 21259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.241040 21259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:59.241086 21259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.249869 21259 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:36851
I20260809 01:57:59.249912 21397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:36851 every 8 connection(s)
I20260809 01:57:59.250667 21259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:57:59.254279 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21259
I20260809 01:57:59.254422 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:57:59.254695 15039 external_mini_cluster.cc:1428] Setting key 02cf1b4861c5fc7fcb87c63ef9bc6334
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:57:59.264603 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.252408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:33497 (local address 127.14.175.254:41949)
0809 01:57:59.252543 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.252547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.253314 (+ 767us) server_negotiation.cc:407] Connection header received
0809 01:57:59.254725 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.254729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.254838 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.254932 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.256364 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.256881 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.258010 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.258244 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.258349 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.260854 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.260858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.260860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.260882 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.262417 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.263016 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.263020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.263021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.263103 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.263472 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.263477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.263479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.263671 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.263797 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.264281 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.264421 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:57:59.265478 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.252736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41949 (local address 127.14.175.194:33497)
0809 01:57:59.253145 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:59.253185 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:59.254527 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:59.255124 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:59.255132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:59.255610 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:59.256207 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.256226 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.257002 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.257005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.257884 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.257894 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.258397 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.258402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.258573 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.259200 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:59.259215 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:59.260697 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:59.262564 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.262570 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.262584 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.262867 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.263204 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.263209 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.263212 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.263366 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.263784 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:59.263791 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:59.264036 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 01:57:59.264233 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 01:57:59.264589 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":105,"threads_started":1}
I20260809 01:57:59.266687 21399 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41949
I20260809 01:57:59.266923 21399 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:57:59.267525 21399 heartbeater.cc:511] Master 127.14.175.254:41949 requested a full tablet report, sending...
I20260809 01:57:59.268563 21051 ts_manager.cc:194] Registered new tserver with Master: 5013de83dc6a4e8aa823a78a2a85de76 (127.14.175.194:36851)
I20260809 01:57:59.269129 21051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:33497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:57:59.284117 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:44453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:57:59.394351 21404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:57:59.394644 21404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:57:59.394717 21404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:57:59.398890 21404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:57:59.399013 21404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:57:59.399137 21404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:57:59.404613 21404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:44453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:41949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:57:59.405613 21404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:57:59.406586 21404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:57:59.415927 21411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:59.415975 21414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:57:59.416121 21412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:57:59.416195 21404 server_base.cc:1034] running on GCE node
I20260809 01:57:59.416632 21404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:57:59.417295 21404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:57:59.418483 21404 hybrid_clock.cc:648] HybridClock initialized: now 1786240679418469 us; error 26 us; skew 500 ppm
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.421350 21404 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:57:59.422338 21404 webserver.cc:460] Webserver started at http://127.14.175.195:43061/ using document root <none> and password file <none>
I20260809 01:57:59.423017 21404 fs_manager.cc:359] Metadata directory not provided
I20260809 01:57:59.423127 21404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:57:59.423343 21404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:57:59.425395 21404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "e2e0b2df076c4727b350e6f988c4ec6a"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "3f86078cba7488072857bcb488e6793b"
server_key_iv: "38586204284262ce9a2886d70a215b85"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.425976 21404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "e2e0b2df076c4727b350e6f988c4ec6a"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "3f86078cba7488072857bcb488e6793b"
server_key_iv: "38586204284262ce9a2886d70a215b85"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.429821 21404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 01:57:59.432480 21421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.433642 21404 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:57:59.433773 21404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "e2e0b2df076c4727b350e6f988c4ec6a"
format_stamp: "Formatted at 2026-08-09 01:57:59 on dist-test-slave-2w3w"
server_key: "3f86078cba7488072857bcb488e6793b"
server_key_iv: "38586204284262ce9a2886d70a215b85"
server_key_version: "encryptionkey@0"
I20260809 01:57:59.433885 21404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:57:59.456105 21404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:57:59.459486 21404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:57:59.459692 21404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:57:59.460290 21404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:57:59.461099 21404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:57:59.461167 21404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.461234 21404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:57:59.461279 21404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:57:59.470309 21404 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:39969
I20260809 01:57:59.470350 21544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:39969 every 8 connection(s)
I20260809 01:57:59.471272 21404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:57:59.481089 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21404
I20260809 01:57:59.481235 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:57:59.481554 15039 external_mini_cluster.cc:1428] Setting key 15ac2da6905ea22d027d969ea2cc5311
I20260809 01:57:59.484822 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.472982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:50887 (local address 127.14.175.254:41949)
0809 01:57:59.473153 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.473158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.473957 (+ 799us) server_negotiation.cc:407] Connection header received
0809 01:57:59.475349 (+ 1392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.475352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.475398 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.475475 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.476566 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.477093 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.478170 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.478381 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.478461 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.480900 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.480903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.480905 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.480929 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.482459 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.483064 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.483068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.483069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.483158 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.483582 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.483585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.483587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.483791 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.483905 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.484496 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.484623 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 01:57:59.485625 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.473365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:41949 (local address 127.14.175.195:50887)
0809 01:57:59.473795 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 01:57:59.473837 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:57:59.475146 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:57:59.475632 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:57:59.475638 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:57:59.475981 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:57:59.476446 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.476461 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.477195 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.477198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.478065 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:57:59.478074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.478508 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.478510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:57:59.478643 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.479283 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:57:59.479299 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:57:59.480739 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:57:59.482605 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.482611 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.482624 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.482928 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.483252 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:57:59.483255 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:57:59.483257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:57:59.483480 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:57:59.483927 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:57:59.483932 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:57:59.484166 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 01:57:59.484419 (+ 253us) client_negotiation.cc:240] Negotiation successful
0809 01:57:59.484742 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
I20260809 01:57:59.486636 21545 heartbeater.cc:347] Connected to a master server at 127.14.175.254:41949
I20260809 01:57:59.486871 21545 heartbeater.cc:464] Registering TS with master...
I20260809 01:57:59.487391 21545 heartbeater.cc:511] Master 127.14.175.254:41949 requested a full tablet report, sending...
I20260809 01:57:59.488335 21051 ts_manager.cc:194] Registered new tserver with Master: e2e0b2df076c4727b350e6f988c4ec6a (127.14.175.195:39969)
I20260809 01:57:59.488919 21051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:50887
I20260809 01:57:59.495538 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/test-admin.keytab.
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.511770 15039 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 01:57:59.514535 21552 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:59.513120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.14.175.193:40169)
0809 01:57:59.513431 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.513442 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.513466 (+ 24us) server_negotiation.cc:407] Connection header received
0809 01:57:59.513526 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.513531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.513709 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.513830 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.514309 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40352: BlockingRecv error: recv got EOF from 127.0.0.1:40352 (error 108)
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
W20260809 01:57:59.514776 15039 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc)
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.515815 15039 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.516741 15039 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:59.526117 21552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.517609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40360 (local address 127.14.175.193:40169)
0809 01:57:59.517752 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.517755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.517770 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:57:59.517865 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.517868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.517909 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.517979 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.518466 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.519290 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.520074 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.520443 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.520524 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.522874 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.522884 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.522896 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.522918 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.524550 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.524930 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.524935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.524936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.525008 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.525222 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.525224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.525225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.525460 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.525602 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.525775 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.525937 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 01:57:59.529909 21552 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:59.528893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40376 (local address 127.14.175.193:40169)
0809 01:57:59.529027 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.529032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.529163 (+ 131us) server_negotiation.cc:407] Connection header received
0809 01:57:59.529297 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.529300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.529341 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.529417 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.529810 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40376: BlockingRecv error: recv got EOF from 127.0.0.1:40376 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 01:57:59.530045 15039 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc' of type FILE
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.531172 15039 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.532158 15039 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:59.541071 21552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.533149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.14.175.193:40169)
0809 01:57:59.533277 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.533281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.533392 (+ 111us) server_negotiation.cc:407] Connection header received
0809 01:57:59.533527 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.533535 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.533569 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.533646 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.534116 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.534614 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.535450 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.535678 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.535780 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.537943 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.537947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.537950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.537974 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.539498 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.539911 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.539915 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.539917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.539999 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.540269 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.540273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.540275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.540436 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.540577 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.540802 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.540904 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 01:57:59.543648 21552 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:57:59.542773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40390 (local address 127.14.175.193:40169)
0809 01:57:59.542924 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.542927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.542940 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:57:59.543106 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.543114 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.543150 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.543215 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.543560 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40390: BlockingRecv error: recv got EOF from 127.0.0.1:40390 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260809 01:57:59.543761 15039 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786240649484061-15039-0/krb5kdc/krb5cc' of type FILE
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.544724 15039 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:57:59.545691 15039 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 01:57:59.553984 21552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:57:59.546434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40406 (local address 127.14.175.193:40169)
0809 01:57:59.546544 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 01:57:59.546548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:57:59.546670 (+ 122us) server_negotiation.cc:407] Connection header received
0809 01:57:59.546744 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:57:59.546746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:57:59.546779 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:57:59.546842 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:57:59.547396 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.547855 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.548668 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:57:59.548869 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:57:59.548943 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:57:59.551070 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:57:59.551073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:57:59.551075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:57:59.551095 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:57:59.552435 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.552852 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.552860 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.552862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.552931 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:57:59.553224 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:57:59.553228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:57:59.553230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:57:59.553382 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:57:59.553506 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 01:57:59.553740 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 01:57:59.553844 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 01:57:59.554950 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21115
I20260809 01:57:59.564332 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21259
I20260809 01:57:59.570914 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21404
I20260809 01:57:59.578482 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21015
2026-08-09T01:57:59Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2221 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21567](info): set up 2 sockets
Aug 09 01:57:59 dist-test-slave-2w3w krb5kdc[21567](info): commencing operation
krb5kdc: starting...
W20260809 01:58:00.649184 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:00 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab.
Entry for principal oryx/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab.
I20260809 01:58:00.772382 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39743
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab
--principal=oryx/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:00.881299 21582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:00.881592 21582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:00.881659 21582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:00.885592 21582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:00.885669 21582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:00.885707 21582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:00.885805 21582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:00.885844 21582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:00.890910 21582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab
--principal=oryx/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:00.891898 21582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:00.892824 21582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:00.901021 21588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:00.901206 21582 server_base.cc:1034] running on GCE node
W20260809 01:58:00.901017 21590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:00.901019 21587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:00.901854 21582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:00.902829 21582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:00.904036 21582 hybrid_clock.cc:648] HybridClock initialized: now 1786240680904004 us; error 24 us; skew 500 ppm
Aug 09 01:58:00 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:00.906847 21582 init.cc:377] Logged in from keytab as oryx/127.14.175.254@KRBTEST.COM (short username oryx)
I20260809 01:58:00.907711 21582 webserver.cc:460] Webserver started at http://127.14.175.254:38145/ using document root <none> and password file <none>
I20260809 01:58:00.908294 21582 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:00.908357 21582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:00.908532 21582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:00.910491 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "0a902783da6646c3a5e823784f969840"
format_stamp: "Formatted at 2026-08-09 01:58:00 on dist-test-slave-2w3w"
server_key: "95ae9dda62634fe1c8b0e9ad98daef62"
server_key_iv: "c7825328c04c866ff3a86a9668dc2552"
server_key_version: "encryptionkey@0"
I20260809 01:58:00.911056 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "0a902783da6646c3a5e823784f969840"
format_stamp: "Formatted at 2026-08-09 01:58:00 on dist-test-slave-2w3w"
server_key: "95ae9dda62634fe1c8b0e9ad98daef62"
server_key_iv: "c7825328c04c866ff3a86a9668dc2552"
server_key_version: "encryptionkey@0"
I20260809 01:58:00.914435 21582 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 01:58:00.916723 21597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:00.917860 21582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:00.917979 21582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "0a902783da6646c3a5e823784f969840"
format_stamp: "Formatted at 2026-08-09 01:58:00 on dist-test-slave-2w3w"
server_key: "95ae9dda62634fe1c8b0e9ad98daef62"
server_key_iv: "c7825328c04c866ff3a86a9668dc2552"
server_key_version: "encryptionkey@0"
I20260809 01:58:00.918074 21582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:00.941160 21582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:00.944440 21582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:00.944646 21582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:00.952021 21582 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:39743
I20260809 01:58:00.952049 21653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:39743 every 8 connection(s)
I20260809 01:58:00.952996 21582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:00.955648 21654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:00.958712 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21582
I20260809 01:58:00.958865 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:00.959224 15039 external_mini_cluster.cc:1428] Setting key bf84b7f0484965cbe29ac387b2f0c548
I20260809 01:58:00.961468 21654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Bootstrap starting.
I20260809 01:58:00.963544 21654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:00.964285 21654 log.cc:824] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:00.966112 21654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: No bootstrap required, opened a new log
Aug 09 01:58:00 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:00.969969 21654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } }
I20260809 01:58:00.970206 21654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:00.970285 21654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a902783da6646c3a5e823784f969840, State: Initialized, Role: FOLLOWER
I20260809 01:58:00.970708 21654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } }
I20260809 01:58:00.970867 21654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:00.970948 21654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:00.971086 21654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:00.972034 21654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } }
I20260809 01:58:00.972398 21654 leader_election.cc:302] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a902783da6646c3a5e823784f969840; no voters:
I20260809 01:58:00.972761 21654 leader_election.cc:288] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:00.972893 21659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:00.973109 21659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 LEADER]: Becoming Leader. State: Replica: 0a902783da6646c3a5e823784f969840, State: Running, Role: LEADER
I20260809 01:58:00.973409 21659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } }
I20260809 01:58:00.973629 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:00.960664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39796 (local address 127.14.175.254:39743)
0809 01:58:00.961058 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:00.961073 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:00.961107 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:58:00.961755 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:00.961773 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:00.962074 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:00.962380 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:00.963225 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:00.964253 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:00.965349 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:00.965815 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:00.965985 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:00.968595 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:00.968600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:00.968612 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:00.968638 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:00.970282 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:00.970804 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:00.970810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:00.970814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:00.970969 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:00.971349 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:00.971351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:00.971352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:00.971789 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:00.971942 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:00.972283 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 01:58:00.972606 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":117,"threads_started":1}
I20260809 01:58:00.973994 21654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:00.974545 21659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a902783da6646c3a5e823784f969840. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } }
I20260809 01:58:00.974658 21659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:00.974997 21660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } }
I20260809 01:58:00.975090 21660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
W20260809 01:58:00.978503 21674 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:00.978590 21674 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:00.978669 21664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:00.979410 21664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:00.984606 21664 catalog_manager.cc:1347] Generated new cluster ID: ccb08ff55cb64b06b9ca0545f70c3730
I20260809 01:58:00.984670 21664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:01.000645 21664 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:01.001889 21664 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:01.007485 21664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Generated new TSK 0
I20260809 01:58:01.008126 21664 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
I20260809 01:58:01.042454 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:01.155557 21680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:01.155797 21680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:01.155839 21680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:01.160269 21680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:01.160331 21680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:01.160387 21680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:01.165434 21680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:01.166309 21680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:01.167227 21680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:01.176965 21686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.176952 21689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.177080 21680 server_base.cc:1034] running on GCE node
W20260809 01:58:01.176954 21685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.177662 21680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:01.178238 21680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:01.179414 21680 hybrid_clock.cc:648] HybridClock initialized: now 1786240681179391 us; error 34 us; skew 500 ppm
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:01.182152 21680 init.cc:377] Logged in from keytab as oryx/127.14.175.193@KRBTEST.COM (short username oryx)
I20260809 01:58:01.183045 21680 webserver.cc:460] Webserver started at http://127.14.175.193:40695/ using document root <none> and password file <none>
I20260809 01:58:01.183604 21680 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:01.183691 21680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:01.183892 21680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:01.185833 21680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "78a2d59953184fc39bef567b252130fe"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "96b8829422ca9ae993dbff5f9c775c46"
server_key_iv: "98c8168119b52d0ced2fde0aa082cc0d"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.186403 21680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "78a2d59953184fc39bef567b252130fe"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "96b8829422ca9ae993dbff5f9c775c46"
server_key_iv: "98c8168119b52d0ced2fde0aa082cc0d"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.189932 21680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 01:58:01.192211 21697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.193341 21680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:01.193468 21680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "78a2d59953184fc39bef567b252130fe"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "96b8829422ca9ae993dbff5f9c775c46"
server_key_iv: "98c8168119b52d0ced2fde0aa082cc0d"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.193574 21680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:01.206236 21680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:01.208830 21680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:01.209019 21680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:01.209582 21680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:01.210330 21680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:01.210397 21680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.210458 21680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:01.210521 21680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.219759 21680 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:38653
I20260809 01:58:01.219798 21819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:38653 every 8 connection(s)
I20260809 01:58:01.220582 21680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:01.229688 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21680
I20260809 01:58:01.229827 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:01.230121 15039 external_mini_cluster.cc:1428] Setting key bc92a8be08e0b0c3b9f1d575b65d766c
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:01.234563 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.222379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38263 (local address 127.14.175.254:39743)
0809 01:58:01.222514 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.222518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.223429 (+ 911us) server_negotiation.cc:407] Connection header received
0809 01:58:01.224903 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.224906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.224952 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.225021 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.226348 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.226880 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.228118 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.228338 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.228412 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.231016 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.231020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.231022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.231053 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.232500 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.233010 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.233014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.233016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.233095 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.233483 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.233486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.233487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.233666 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.233749 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.234332 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.234433 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 01:58:01.235488 21822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.222781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:38263)
0809 01:58:01.223254 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.223296 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.224663 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.225222 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.225230 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.225729 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.226219 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.226233 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.227038 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.227041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.228001 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.228010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.228462 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.228465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.228615 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.229175 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.229190 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.230840 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.232630 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.232635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.232647 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.232897 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.233182 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.233186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.233188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.233376 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.233771 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.233779 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.234092 (+ 313us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.234315 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.234668 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":140,"threads_started":1}
I20260809 01:58:01.236629 21820 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:01.236860 21820 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:01.237298 21820 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:01.238688 21615 ts_manager.cc:194] Registered new tserver with Master: 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
I20260809 01:58:01.239804 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:38263
WARNING: no policy specified for oryx/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
I20260809 01:58:01.258391 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:01.365342 21825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:01.365589 21825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:01.365662 21825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:01.369601 21825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:01.369656 21825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:01.369756 21825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:01.375052 21825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:01.376034 21825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:01.377022 21825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:01.386471 21833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.386495 21830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.386515 21831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.386749 21825 server_base.cc:1034] running on GCE node
I20260809 01:58:01.387287 21825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:01.387866 21825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:01.389042 21825 hybrid_clock.cc:648] HybridClock initialized: now 1786240681389026 us; error 26 us; skew 500 ppm
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:01.391772 21825 init.cc:377] Logged in from keytab as oryx/127.14.175.194@KRBTEST.COM (short username oryx)
I20260809 01:58:01.392589 21825 webserver.cc:460] Webserver started at http://127.14.175.194:40539/ using document root <none> and password file <none>
I20260809 01:58:01.393122 21825 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:01.393214 21825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:01.393432 21825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:01.395464 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "71051690836247dd8e2bf70930a09d1f"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "b2a929618b6cdfb55ac457a9d5dfa796"
server_key_iv: "bee22a0aea9733a5e37785589ec26223"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.396023 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "71051690836247dd8e2bf70930a09d1f"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "b2a929618b6cdfb55ac457a9d5dfa796"
server_key_iv: "bee22a0aea9733a5e37785589ec26223"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.399870 21825 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 01:58:01.402179 21840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.403425 21825 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:58:01.403551 21825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "71051690836247dd8e2bf70930a09d1f"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "b2a929618b6cdfb55ac457a9d5dfa796"
server_key_iv: "bee22a0aea9733a5e37785589ec26223"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.403656 21825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:01.429695 21825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:01.432840 21825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:01.433076 21825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:01.433641 21825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:01.434441 21825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:01.434509 21825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.434579 21825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:01.434618 21825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.443508 21825 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:34553
I20260809 01:58:01.443521 21962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:34553 every 8 connection(s)
I20260809 01:58:01.444478 21825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:01.454516 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21825
I20260809 01:58:01.454658 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:01.455065 15039 external_mini_cluster.cc:1428] Setting key 9883034ba146f59f70ee7d83fff58dbc
I20260809 01:58:01.457957 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.446211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:54139 (local address 127.14.175.254:39743)
0809 01:58:01.446335 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.446339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.447213 (+ 874us) server_negotiation.cc:407] Connection header received
0809 01:58:01.448508 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.448511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.448570 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.448674 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.449752 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.450284 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.451432 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.451663 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.451773 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.454036 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.454039 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.454041 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.454067 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.455605 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.456231 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.456234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.456235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.456323 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.456779 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.456783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.456785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.457021 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.457146 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.457581 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.457730 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 01:58:01.458536 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.446509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:54139)
0809 01:58:01.447065 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.447107 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.448307 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.448837 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.448843 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.449169 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.449609 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.449622 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.450408 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.450413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.451315 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.451325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.451810 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.451814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.451975 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.452484 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.452499 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.453858 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.455731 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.455737 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.455754 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.456128 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.456466 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.456469 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.456474 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.456652 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.457136 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.457140 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.457356 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.457500 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.457728 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":158,"threads_started":1}
I20260809 01:58:01.459926 21963 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:01.460172 21963 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:01.460644 21963 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:01.461651 21615 ts_manager.cc:194] Registered new tserver with Master: 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:01.462182 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:54139
WARNING: no policy specified for oryx/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
I20260809 01:58:01.485874 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:01.594312 21968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:01.594563 21968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:01.594638 21968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:01.598706 21968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:01.598783 21968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:01.598868 21968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:01.603812 21968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:01.604722 21968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:01.605672 21968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:01.614769 21974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.614753 21977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.614810 21973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.615216 21968 server_base.cc:1034] running on GCE node
I20260809 01:58:01.615597 21968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:01.616166 21968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:01.617343 21968 hybrid_clock.cc:648] HybridClock initialized: now 1786240681617317 us; error 44 us; skew 500 ppm
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:01.620055 21968 init.cc:377] Logged in from keytab as oryx/127.14.175.195@KRBTEST.COM (short username oryx)
I20260809 01:58:01.621004 21968 webserver.cc:460] Webserver started at http://127.14.175.195:37257/ using document root <none> and password file <none>
I20260809 01:58:01.621534 21968 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:01.621620 21968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:01.621820 21968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:01.623817 21968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "dada43cb211e49f7b67effefb595971b"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "26d4ffb9feb7d44e5de579cb3d89fae4"
server_key_iv: "cd16c8d7096b6dd692b3a952417e99f0"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.624384 21968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "dada43cb211e49f7b67effefb595971b"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "26d4ffb9feb7d44e5de579cb3d89fae4"
server_key_iv: "cd16c8d7096b6dd692b3a952417e99f0"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.628010 21968 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 01:58:01.630330 21984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.631639 21968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:01.631769 21968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "dada43cb211e49f7b67effefb595971b"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "26d4ffb9feb7d44e5de579cb3d89fae4"
server_key_iv: "cd16c8d7096b6dd692b3a952417e99f0"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.631872 21968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:01.647750 21968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:01.650756 21968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:01.650939 21968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:01.651561 21968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:01.652340 21968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:01.652415 21968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.652482 21968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:01.652514 21968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.661275 21968 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:43305
I20260809 01:58:01.661299 22110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:43305 every 8 connection(s)
I20260809 01:58:01.662122 21968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:01.671846 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 21968
I20260809 01:58:01.671988 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:01.672264 15039 external_mini_cluster.cc:1428] Setting key 0cfed593d49dfe6477cf53e117a3d0ce
I20260809 01:58:01.675511 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.664022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:34425 (local address 127.14.175.254:39743)
0809 01:58:01.664176 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.664181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.664915 (+ 734us) server_negotiation.cc:407] Connection header received
0809 01:58:01.666149 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.666151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.666200 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.666273 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.667460 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.667982 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.669046 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.669268 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.669347 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.671646 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.671650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.671652 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.671674 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.673317 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.673886 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.673890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.673892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.673968 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.674356 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.674359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.674361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.674568 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.674700 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.675258 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.675386 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 01:58:01.676309 22113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.664327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:34425)
0809 01:58:01.664755 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.664795 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.665961 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.666440 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.666446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.666800 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.667328 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.667341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.668095 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.668098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.668939 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.668948 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.669402 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.669404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.669537 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.670027 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.670042 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.671477 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.673427 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.673433 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.673446 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.673795 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.674062 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.674065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.674067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.674248 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.674701 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.674706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.675006 (+ 300us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.675219 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.675463 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":116,"threads_started":1}
I20260809 01:58:01.677287 22111 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:01.677502 22111 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:01.677892 22111 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:01.678762 21615 ts_manager.cc:194] Registered new tserver with Master: dada43cb211e49f7b67effefb595971b (127.14.175.195:43305)
I20260809 01:58:01.679340 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:34425
I20260809 01:58:01.685956 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.253.keytab.
Entry for principal oryx/127.14.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.253.keytab.
I20260809 01:58:01.713977 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:34271
--webserver_interface=127.14.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.253.keytab
--principal=oryx/127.14.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39743,127.14.175.253:34271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:01.824980 22118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:01.825217 22118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:01.825255 22118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:01.829161 22118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:01.829214 22118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:01.829233 22118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:01.829278 22118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:01.829311 22118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:01.834501 22118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39743,127.14.175.253:34271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.253.keytab
--principal=oryx/127.14.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:34271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
W20260809 01:58:01.834682 22118 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.14.175.254:39743,127.14.175.253:34271'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 01:58:01.835618 22118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:01.836551 22118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:01.844924 22127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:01.844962 22125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.845139 22118 server_base.cc:1034] running on GCE node
W20260809 01:58:01.844940 22124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:01.845857 22118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:01.846829 22118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:01.848009 22118 hybrid_clock.cc:648] HybridClock initialized: now 1786240681847996 us; error 26 us; skew 500 ppm
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:01.850661 22118 init.cc:377] Logged in from keytab as oryx/127.14.175.253@KRBTEST.COM (short username oryx)
I20260809 01:58:01.851521 22118 webserver.cc:460] Webserver started at http://127.14.175.253:37263/ using document root <none> and password file <none>
I20260809 01:58:01.852044 22118 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:01.852129 22118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:01.852347 22118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:01.854288 22118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/instance:
uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "5a0bdc48a61256ae1af6697a51310325"
server_key_iv: "0bc1f634b419c71e6bfadd85e1d540dd"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.854856 22118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal/instance:
uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "5a0bdc48a61256ae1af6697a51310325"
server_key_iv: "0bc1f634b419c71e6bfadd85e1d540dd"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.858342 22118 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 01:58:01.860674 22134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:01.861828 22118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 01:58:01.861984 22118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "5a0bdc48a61256ae1af6697a51310325"
server_key_iv: "0bc1f634b419c71e6bfadd85e1d540dd"
server_key_version: "encryptionkey@0"
I20260809 01:58:01.862097 22118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:01.881685 22118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:01.884454 22118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:01.884644 22118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:01.891201 22118 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.253:34271
I20260809 01:58:01.891486 22193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.253:34271 every 8 connection(s)
I20260809 01:58:01.892194 22118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
I20260809 01:58:01.894665 22194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:01.898638 22194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } has no permanent_uuid. Determining permanent_uuid...
I20260809 01:58:01.900485 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 22118
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.253@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
I20260809 01:58:01.913775 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.900535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.14.175.254:39743)
0809 01:58:01.900685 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.900688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.903352 (+ 2664us) server_negotiation.cc:407] Connection header received
0809 01:58:01.903464 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.903467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.903515 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.903599 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.904573 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.905360 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.906752 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.907140 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.907250 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.910151 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.910154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.910156 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.910179 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.911741 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.912207 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.912211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.912213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.912291 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.912629 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.912634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.912636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.912844 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.913106 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.913474 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.913594 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 01:58:01.914706 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.900970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39808)
0809 01:58:01.903203 (+ 2233us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.903240 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.903372 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.903675 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.903680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.904157 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.904434 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.904445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.905485 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.905487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.906635 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.906648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.907273 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.907276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.907485 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.908262 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.908282 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.909927 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.911860 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.911868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.911877 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.912106 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.912387 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.912390 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.912392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.912537 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.913103 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.913108 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.913235 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.913431 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.913804 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2068,"mutex_wait_us":132,"spinlock_wait_cycles":768,"thread_start_us":137,"threads_started":1}
I20260809 01:58:01.914706 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.901771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.14.175.253:34271)
0809 01:58:01.902110 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.902124 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.902156 (+ 32us) server_negotiation.cc:407] Connection header received
0809 01:58:01.902746 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.902760 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.903129 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.903390 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.904275 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.905596 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.906724 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.907316 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.907497 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.910468 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.910473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.910481 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.910501 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.911960 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.912377 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.912386 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.912387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.912492 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.912757 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.912761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.912763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.913077 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.913272 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.913522 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.913741 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":218,"spinlock_wait_cycles":12160,"thread_start_us":126,"threads_started":1}
I20260809 01:58:01.916117 22194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240681, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.253@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
I20260809 01:58:01.923410 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.916560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43248)
0809 01:58:01.916644 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.916655 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.916711 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.917113 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.917116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.917261 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.917343 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.917347 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.918040 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.918047 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.918541 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.918548 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.919000 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.919003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.919090 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.919440 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.919450 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.920532 (+ 1082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.922017 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.922022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.922026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.922209 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.922470 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.922472 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.922474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.922547 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.922886 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.922889 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.922997 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.923111 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.923247 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 01:58:01.923410 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.916850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43248 (local address 127.14.175.253:34271)
0809 01:58:01.916956 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.916959 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.916969 (+ 10us) server_negotiation.cc:407] Connection header received
0809 01:58:01.916993 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.916995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.917023 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.917102 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.917453 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.917943 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.918648 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.918879 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.918998 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.920699 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.920702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.920704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.920729 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.921927 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.922299 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.922304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.922306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.922376 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.922627 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.922632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.922634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.922785 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.922886 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.923166 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.923293 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":41}
I20260809 01:58:01.926343 22194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Bootstrap starting.
I20260809 01:58:01.928771 22194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:01.929472 22194 log.cc:824] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:01.931183 22194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: No bootstrap required, opened a new log
I20260809 01:58:01.933871 22194 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } }
I20260809 01:58:01.934054 22194 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:01.934144 22194 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8b9c6c4b3744addb88b118cdb3bd0b4, State: Initialized, Role: FOLLOWER
I20260809 01:58:01.934619 22194 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } }
I20260809 01:58:01.935140 22201 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } } }
I20260809 01:58:01.935279 22201 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:01.935911 22194 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 01:58:01.940599 22213 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:01.940685 22213 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:01.943017 22118 master_runner.cc:428] Detected that this master b8b9c6c4b3744addb88b118cdb3bd0b4 is joining an existing cluster
I20260809 01:58:01.943078 22118 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.175.253:34271
I20260809 01:58:01.953727 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.945363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43260 (local address 127.14.175.253:34271)
0809 01:58:01.945467 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.945471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.945885 (+ 414us) server_negotiation.cc:407] Connection header received
0809 01:58:01.945973 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.945975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.946008 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.946078 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.946712 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.947506 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.948597 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.948798 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.948902 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.950182 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.950186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.950188 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.950214 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.951912 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952422 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.952427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.952429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.952496 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952785 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.952789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.952792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.953035 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.953107 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.953408 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.953547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":30}
I20260809 01:58:01.953960 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.945323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39820 (local address 127.14.175.254:39743)
0809 01:58:01.945495 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.945499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.945770 (+ 271us) server_negotiation.cc:407] Connection header received
0809 01:58:01.945942 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.945946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.945998 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.946078 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.946700 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.947332 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.948543 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.948899 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.949003 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.950402 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.950408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.950414 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.950444 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.952070 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952614 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.952617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.952619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.952695 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.953008 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.953012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.953014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.953233 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.953304 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.953697 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.953817 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 01:58:01.954201 22221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.945243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43260)
0809 01:58:01.945781 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.945795 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.945896 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.946109 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.946113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.946405 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.946591 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.946599 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.947621 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.947624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.948439 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.948449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.948912 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.948915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.949053 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.949558 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.949580 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.950050 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.952069 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.952075 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.952320 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.952603 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952605 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.952607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.952689 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.953165 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.953168 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.953243 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.953855 (+ 612us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.953979 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":68,"thread_start_us":105,"threads_started":1}
I20260809 01:58:01.955286 22220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.945242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39820)
0809 01:58:01.945694 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.945708 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.945803 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.946180 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.946183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.946412 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.946579 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.946584 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.947430 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.947436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.948397 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.948407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.949121 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.949125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.949238 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.949728 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.949746 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.950243 (+ 497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.952249 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952253 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.952255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.952486 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.952804 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.952807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.952808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.952903 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.953375 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.953391 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.953474 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.954931 (+ 1457us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.955126 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":28,"thread_start_us":112,"threads_started":1}
Aug 09 01:58:01 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.254@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
I20260809 01:58:01.972141 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.959550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43266)
0809 01:58:01.963217 (+ 3667us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:01.963257 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:01.963399 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:01.963714 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:01.963720 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:01.964095 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:01.964201 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.964207 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.965016 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.965019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.965749 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:01.965791 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.966406 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.966409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:01.966542 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.967083 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:01.967095 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:01.968556 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:01.970306 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.970319 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.970327 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.970660 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.971023 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:01.971027 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:01.971031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:01.971136 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:01.971571 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:01.971576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:01.971698 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 01:58:01.971844 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 01:58:01.972017 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3514,"thread_start_us":71,"threads_started":1}
I20260809 01:58:01.972193 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:01.959569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43266 (local address 127.14.175.253:34271)
0809 01:58:01.959673 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:01.959677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:01.963331 (+ 3654us) server_negotiation.cc:407] Connection header received
0809 01:58:01.963536 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:01.963540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:01.963594 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:01.963677 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:01.964319 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.964878 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.965955 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:01.966242 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:01.966400 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:01.968689 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:01.968692 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:01.968695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:01.968719 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:01.970162 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.970779 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.970782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.970784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.970876 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:01.971238 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:01.971241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:01.971243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:01.971457 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:01.971557 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:01.971929 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 01:58:01.972041 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 01:58:01.973575 21615 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.175.253:34271: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
member_type: NON_VOTER
last_known_addr {
host: "127.14.175.253"
port: 34271
}
attrs {
promote: true
}
}
dest_uuid: "0a902783da6646c3a5e823784f969840"
cas_config_opid_index: -1
I20260809 01:58:01.974232 21615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } }
I20260809 01:58:01.975875 22225 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } }
I20260809 01:58:01.976676 22166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:01.977551 22225 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.175.253:34271
I20260809 01:58:01.977979 22118 master.cc:537] Master@127.14.175.253:34271 shutting down...
I20260809 01:58:01.978013 22224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } }
I20260809 01:58:01.978109 22224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:01.978415 22166 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 01:58:01.979203 22225 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.14.175.252@KRBTEST.COM; defaulting to no policy
W20260809 01:58:01.981621 21600 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 01:58:01.982635 21600 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 -> Peer b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253:34271): Couldn't send request to peer b8b9c6c4b3744addb88b118cdb3bd0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 01:58:01.982726 22118 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:01.983016 22118 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:01.983140 22118 tablet_replica.cc:330] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.252@KRBTEST.COM" created.
I20260809 01:58:02.000514 22118 master.cc:552] Master@127.14.175.253:34271 shutdown complete.
I20260809 01:58:02.000602 22118 master_runner.cc:305] Clearing existing system tablet
I20260809 01:58:02.000823 22118 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.000886 22118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.001979 22118 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 01:58:02.002854 22230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.003130 22118 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.003250 22118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:02.003275 22118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "5a0bdc48a61256ae1af6697a51310325"
server_key_iv: "0bc1f634b419c71e6bfadd85e1d540dd"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.005092 22118 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.252.keytab.
Entry for principal oryx/127.14.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.252.keytab.
I20260809 01:58:02.006623 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:43265
--webserver_interface=127.14.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.252.keytab
--principal=oryx/127.14.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 01:58:02.007390 22118 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 01:58:02.007493 22118 log.cc:1196] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 01:58:02.007745 22118 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Deleting consensus metadata
I20260809 01:58:02.007927 22118 master_runner.cc:315] Copying system tablet from 127.14.175.254:39743
I20260809 01:58:02.009419 22118 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: tablet copy: Beginning tablet copy session from remote peer at address 127.14.175.254:39743
I20260809 01:58:02.019773 22237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.010084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39834)
0809 01:58:02.010538 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.010556 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.010689 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.011046 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.011052 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.011314 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.011485 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.011498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.012680 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.012686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.013806 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.013820 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.014448 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.014453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.014597 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.015236 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.015269 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.015779 (+ 510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.017959 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.017966 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.017970 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.018264 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.018568 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.018574 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.018578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.018691 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.019197 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.019200 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.019296 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.019419 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.019559 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":82,"threads_started":1}
I20260809 01:58:02.019800 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.010195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39834 (local address 127.14.175.254:39743)
0809 01:58:02.010348 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.010355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.010659 (+ 304us) server_negotiation.cc:407] Connection header received
0809 01:58:02.010810 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.010814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.010869 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.010948 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.011697 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.012547 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.013957 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.014318 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.014419 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.015952 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.015956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.015959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.015986 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.017840 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.018372 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.018376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.018378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.018466 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.018798 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.018801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.018802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.019053 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.019151 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.019510 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.019638 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:58:02.020814 21638 tablet_copy_service.cc:140] P 0a902783da6646c3a5e823784f969840: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b8b9c6c4b3744addb88b118cdb3bd0b4 ({username='oryx', principal='oryx/127.14.175.253@KRBTEST.COM'} at 127.0.0.1:39834)
I20260809 01:58:02.021023 21638 tablet_copy_service.cc:161] P 0a902783da6646c3a5e823784f969840: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b8b9c6c4b3744addb88b118cdb3bd0b4 at {username='oryx', principal='oryx/127.14.175.253@KRBTEST.COM'} at 127.0.0.1:39834: session id = b8b9c6c4b3744addb88b118cdb3bd0b4-00000000000000000000000000000000
I20260809 01:58:02.022939 21638 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 01:58:02.024762 22118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 01:58:02.027339 22118 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: tablet copy: Starting download of 0 data blocks...
I20260809 01:58:02.027544 22118 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: tablet copy: Starting download of 1 WAL segments...
I20260809 01:58:02.029196 22118 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 01:58:02.030908 21638 tablet_copy_service.cc:342] P 0a902783da6646c3a5e823784f969840: Request end of tablet copy session b8b9c6c4b3744addb88b118cdb3bd0b4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.175.253@KRBTEST.COM'} at 127.0.0.1:39834
I20260809 01:58:02.031047 21638 tablet_copy_service.cc:433] P 0a902783da6646c3a5e823784f969840: ending tablet copy session b8b9c6c4b3744addb88b118cdb3bd0b4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b8b9c6c4b3744addb88b118cdb3bd0b4
I20260809 01:58:02.038940 22118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.040613 22238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.040652 22241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.041018 22239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.041261 22118 server_base.cc:1034] running on GCE node
I20260809 01:58:02.041653 22118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.041949 22118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.043074 22118 hybrid_clock.cc:648] HybridClock initialized: now 1786240682043060 us; error 30 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.044759 22118 init.cc:377] Logged in from keytab as oryx/127.14.175.253@KRBTEST.COM (short username oryx)
I20260809 01:58:02.045218 22118 webserver.cc:460] Webserver started at http://127.14.175.253:34785/ using document root <none> and password file <none>
I20260809 01:58:02.045406 22118 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.045451 22118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.046790 22118 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:02.047785 22249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.048031 22118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 01:58:02.048105 22118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "5a0bdc48a61256ae1af6697a51310325"
server_key_iv: "0bc1f634b419c71e6bfadd85e1d540dd"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.048175 22118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.069227 22118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.071477 22118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.076612 22118 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.253:34271
I20260809 01:58:02.076653 22305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.253:34271 every 8 connection(s)
I20260809 01:58:02.077220 22118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
I20260809 01:58:02.079154 22306 sys_catalog.cc:263] Verifying existing consensus state
I20260809 01:58:02.080233 22306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Bootstrap starting.
I20260809 01:58:02.091260 22306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 01:58:02.091593 22306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: Bootstrap complete.
I20260809 01:58:02.092172 22306 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } }
I20260809 01:58:02.092344 22306 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b8b9c6c4b3744addb88b118cdb3bd0b4, State: Initialized, Role: LEARNER
I20260809 01:58:02.092469 22306 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } }
I20260809 01:58:02.092832 22309 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } }
I20260809 01:58:02.092941 22306 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:02.093025 22309 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: LEARNER
I20260809 01:58:02.096539 22321 catalog_manager.cc:1259] Loaded cluster ID: ccb08ff55cb64b06b9ca0545f70c3730
I20260809 01:58:02.096597 22321 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: loading cluster ID for follower catalog manager: success
I20260809 01:58:02.098915 22321 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: acquiring CA information for follower catalog manager: success
I20260809 01:58:02.100323 22321 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 01:58:02.140497 22231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:02.140719 22231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:02.140784 22231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:02.144789 22231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:02.144840 22231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:02.144876 22231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:02.144913 22231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:02.144940 22231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:02.150118 22231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.252.keytab
--principal=oryx/127.14.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:43265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:02.151055 22231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:02.151995 22231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.160017 22329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.160022 22327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.159998 22326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.160324 22231 server_base.cc:1034] running on GCE node
I20260809 01:58:02.160802 22231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.161789 22231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.163009 22231 hybrid_clock.cc:648] HybridClock initialized: now 1786240682162991 us; error 28 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.165692 22231 init.cc:377] Logged in from keytab as oryx/127.14.175.252@KRBTEST.COM (short username oryx)
I20260809 01:58:02.166499 22231 webserver.cc:460] Webserver started at http://127.14.175.252:43917/ using document root <none> and password file <none>
I20260809 01:58:02.167058 22231 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.167146 22231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.167371 22231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:02.169304 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/instance:
uuid: "bcb4c88ba5c443808cc80162dede835a"
format_stamp: "Formatted at 2026-08-09 01:58:02 on dist-test-slave-2w3w"
server_key: "2e867f1b34444cbd36187806190973c4"
server_key_iv: "37f5f3e040b30371bf314cba3b6f60f9"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.169858 22231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal/instance:
uuid: "bcb4c88ba5c443808cc80162dede835a"
format_stamp: "Formatted at 2026-08-09 01:58:02 on dist-test-slave-2w3w"
server_key: "2e867f1b34444cbd36187806190973c4"
server_key_iv: "37f5f3e040b30371bf314cba3b6f60f9"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.173969 22231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 01:58:02.176396 22336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.177575 22231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:02.177671 22231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "bcb4c88ba5c443808cc80162dede835a"
format_stamp: "Formatted at 2026-08-09 01:58:02 on dist-test-slave-2w3w"
server_key: "2e867f1b34444cbd36187806190973c4"
server_key_iv: "37f5f3e040b30371bf314cba3b6f60f9"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.177747 22231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.190285 22231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.193044 22231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:02.193184 22231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.200233 22231 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.252:43265
I20260809 01:58:02.200534 22396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.252:43265 every 8 connection(s)
I20260809 01:58:02.201215 22231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
I20260809 01:58:02.203744 22397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:02.204231 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 22231
I20260809 01:58:02.208571 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.252@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:02.219496 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.205584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.14.175.252:43265)
0809 01:58:02.205964 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.205983 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.206024 (+ 41us) server_negotiation.cc:407] Connection header received
0809 01:58:02.207003 (+ 979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.207026 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.207424 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.207772 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.208480 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.209952 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.210939 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.211562 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.211732 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.214371 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.214376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.214385 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.214410 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.216264 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.216814 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.216820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.216831 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.216952 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.217253 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.217259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.217260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.217759 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.217955 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.218245 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.218525 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":108,"threads_started":1}
I20260809 01:58:02.220279 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.210514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.14.175.254:39743)
0809 01:58:02.210638 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.210642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.210867 (+ 225us) server_negotiation.cc:407] Connection header received
0809 01:58:02.211096 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.211098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.211141 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.211242 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.211971 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.212486 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.213441 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.213657 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.213735 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.216555 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.216559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.216562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.216593 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.218105 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.218716 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.218721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.218725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.218819 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.219199 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.219204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.219207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.219448 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.219533 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.219996 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.220136 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 01:58:02.220773 22401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.210364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39850)
0809 01:58:02.210723 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.210768 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.210882 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.211289 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.211294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.211617 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.211798 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.211806 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.212625 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.212628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.213303 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.213316 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.213823 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.213829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.213960 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.214567 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.214579 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.216376 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.218243 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.218251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.218256 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.218596 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.218941 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.218945 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.218947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.219077 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.219628 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.219637 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.219755 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.220414 (+ 659us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.220596 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":137,"threads_started":1}
I20260809 01:58:02.222774 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.252@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
I20260809 01:58:02.230911 22401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.223267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43270)
0809 01:58:02.223386 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.223397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.223454 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.224003 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.224006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.224168 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.224248 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.224253 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.225134 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.225140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.225675 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.225683 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.226134 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.226137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.226233 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.226608 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.226620 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.227766 (+ 1146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.229720 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.229723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.229724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.229907 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.230195 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.230197 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.230198 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.230267 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.230584 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.230585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.230654 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.230727 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.230815 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 01:58:02.231098 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.223510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43270 (local address 127.14.175.253:34271)
0809 01:58:02.223767 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.223770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.223781 (+ 11us) server_negotiation.cc:407] Connection header received
0809 01:58:02.223815 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.223818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.223885 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.223988 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.224367 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.225030 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.225807 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.226030 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.226135 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.227940 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.227943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.227945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.227966 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.229622 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.230019 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.230023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.230024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.230108 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.230347 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.230349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.230350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.230509 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.230585 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.230781 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.230886 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":100,"threads_started":1}
I20260809 01:58:02.231781 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.252@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
I20260809 01:58:02.239231 22401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.232215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.0.0.1:35826)
0809 01:58:02.232296 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.232310 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.232378 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.232617 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.232619 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.232741 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.232805 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.232809 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.233919 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.233921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.234403 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.234409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.234816 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.234818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.234899 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.235363 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.235384 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.236539 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.238020 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.238022 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.238023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.238203 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.238450 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.238452 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.238454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.238524 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.238819 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.238821 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.238888 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.239015 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.239130 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":17}
I20260809 01:58:02.239432 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.232349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.14.175.252:43265)
0809 01:58:02.232455 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.232458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.232469 (+ 11us) server_negotiation.cc:407] Connection header received
0809 01:58:02.232496 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.232498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.232528 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.232592 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.232901 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.233814 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.234503 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.234719 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.234809 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.236668 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.236671 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.236673 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.236693 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.237911 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.238281 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.238283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.238284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.238375 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.238596 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.238598 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.238599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.238745 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.238817 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.239140 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.239230 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":44}
I20260809 01:58:02.241873 21820 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.242168 22397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Bootstrap starting.
I20260809 01:58:02.244535 22397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:02.245244 22397 log.cc:824] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:02.247107 22397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: No bootstrap required, opened a new log
I20260809 01:58:02.250075 22397 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } }
I20260809 01:58:02.250284 22397 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:02.250358 22397 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcb4c88ba5c443808cc80162dede835a, State: Initialized, Role: FOLLOWER
I20260809 01:58:02.250758 22397 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } }
I20260809 01:58:02.251238 22404 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } } }
I20260809 01:58:02.251365 22404 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:02.251937 22397 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: configured and running, proceeding with master startup.
W20260809 01:58:02.256500 22417 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:02.256599 22417 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:02.259856 22231 master_runner.cc:428] Detected that this master bcb4c88ba5c443808cc80162dede835a is joining an existing cluster
I20260809 01:58:02.259919 22231 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.175.252:43265
I20260809 01:58:02.270574 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.262322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43286 (local address 127.14.175.253:34271)
0809 01:58:02.262439 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.262443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.262837 (+ 394us) server_negotiation.cc:407] Connection header received
0809 01:58:02.263082 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.263085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.263140 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.263200 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.263731 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.264244 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.265143 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.265380 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.265490 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.266644 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.266648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.266651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.266676 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.268335 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.268814 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.268818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.268820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.268906 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.269199 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.269202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.269204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.269408 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.269479 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.270269 (+ 790us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.270400 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:58:02.271114 22424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.262160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43286)
0809 01:58:02.262755 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.262771 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.262915 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.263345 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.263347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.263519 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.263616 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.263621 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.264353 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.264358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.265020 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.265028 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.265501 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.265505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.265601 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.266130 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.266141 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.266501 (+ 360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.268460 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.268463 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.268465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.268697 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.269019 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.269022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.269023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.269106 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.269554 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.269556 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.270059 (+ 503us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.270744 (+ 685us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.270883 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":443,"thread_start_us":121,"threads_started":1}
I20260809 01:58:02.271529 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.262208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39856 (local address 127.14.175.254:39743)
0809 01:58:02.262318 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.262323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.262584 (+ 261us) server_negotiation.cc:407] Connection header received
0809 01:58:02.262717 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.262721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.262770 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.262824 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.263542 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.264381 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.265620 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.265981 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.266058 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.267367 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.267370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.267373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.267396 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.269657 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.270058 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.270061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.270063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.270164 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.270541 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.270544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.270546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.270740 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.270810 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.271222 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.271355 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 01:58:02.272121 22423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.262155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39856)
0809 01:58:02.262480 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.262495 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.262595 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.263005 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.263009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.263260 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.263403 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.263411 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.264526 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.264530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.265466 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.265477 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.266210 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.266213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.266322 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.266782 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.266793 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.267229 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.269734 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.269737 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.269739 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.269959 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.270286 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.270289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.270291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.270388 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.270881 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.270884 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.271002 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.271739 (+ 737us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.271887 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":2,"thread_start_us":132,"threads_started":1}
I20260809 01:58:02.274685 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21680
I20260809 01:58:02.276185 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.263096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.0.0.1:35836)
0809 01:58:02.267555 (+ 4459us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.267569 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.267684 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.267964 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.267966 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.268178 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.268273 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.268280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.269531 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.269534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.270356 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.270364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.271465 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.271469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.271557 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.272436 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.272451 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.272748 (+ 297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.274702 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.274705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.274707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.275020 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.275279 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.275282 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.275284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.275362 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.275736 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.275738 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.275805 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.275889 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.276009 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4042,"mutex_wait_us":3,"thread_start_us":85,"threads_started":1}
I20260809 01:58:02.276486 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.262887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.14.175.252:43265)
0809 01:58:02.263012 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.263017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.267633 (+ 4616us) server_negotiation.cc:407] Connection header received
0809 01:58:02.267771 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.267774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.267806 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.267849 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.268406 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.269403 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.270485 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.270797 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.270871 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.272875 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.272881 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.272884 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.272911 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.274590 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.275119 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.275122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.275123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.275191 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.275443 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.275446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.275448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.275622 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.275696 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.276069 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.276241 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 01:58:02.289758 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:38653
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:39743
--webserver_port=40695
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240680, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.254@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
I20260809 01:58:02.306865 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.297260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.0.0.1:35846)
0809 01:58:02.297442 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.297455 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.297528 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.297857 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.297860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.298061 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.298169 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.298176 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.299357 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.299363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.300385 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.300401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.301100 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.301106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.301230 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.301758 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.301772 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.303374 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.305299 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.305303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.305305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.305560 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.305844 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.305847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.305849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.305942 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.306345 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.306348 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.306441 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.306550 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.306693 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 01:58:02.307337 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.297366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35846 (local address 127.14.175.252:43265)
0809 01:58:02.297501 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.297519 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.297538 (+ 19us) server_negotiation.cc:407] Connection header received
0809 01:58:02.297646 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.297651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.297721 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.297813 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.298294 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.299197 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.300549 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.300937 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.301030 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.303520 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.303524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.303527 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.303558 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.305183 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.305665 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.305668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.305670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.305755 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.306039 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.306042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.306044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.306244 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.306337 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.306621 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.306734 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:58:02.308322 21615 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.175.252:43265: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bcb4c88ba5c443808cc80162dede835a"
member_type: NON_VOTER
last_known_addr {
host: "127.14.175.252"
port: 43265
}
attrs {
promote: true
}
}
dest_uuid: "0a902783da6646c3a5e823784f969840"
cas_config_opid_index: 5
I20260809 01:58:02.309051 21615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } }
I20260809 01:58:02.310065 22225 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bcb4c88ba5c443808cc80162dede835a (127.14.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.311475 22225 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.175.252:43265
I20260809 01:58:02.311683 22225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.311796 22225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:02.312924 22231 master.cc:537] Master@127.14.175.252:43265 shutting down...
I20260809 01:58:02.313082 22367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:02.314325 22367 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 01:58:02.314936 22224 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:02.316541 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.311115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43300 (local address 127.14.175.253:34271)
0809 01:58:02.311969 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.311974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.311989 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:02.312040 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.312042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.312103 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.312199 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:02.312518 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.313315 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.315055 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.315744 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.315839 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.315974 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.316328 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.316406 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767}
I20260809 01:58:02.316905 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.310077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43300)
0809 01:58:02.311373 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.311386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.311452 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.312259 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.312264 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.312283 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:02.312368 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.312373 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.313617 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.313621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.314859 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.314871 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.316072 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.316076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.316163 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.316206 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.316725 (+ 519us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.316799 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1232}
W20260809 01:58:02.317359 21601 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 -> Peer bcb4c88ba5c443808cc80162dede835a (127.14.175.252:43265): Couldn't send request to peer bcb4c88ba5c443808cc80162dede835a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 01:58:02.317368 22269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 LEARNER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 01:58:02.317847 22224 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 01:58:02.319679 22269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bcb4c88ba5c443808cc80162dede835a (127.14.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.321261 22231 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:02.321525 22231 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:02.321647 22231 tablet_replica.cc:330] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: stopping tablet replica
I20260809 01:58:02.321776 22428 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.321945 22428 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: LEARNER
I20260809 01:58:02.321952 22224 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: attempting to promote NON_VOTER b8b9c6c4b3744addb88b118cdb3bd0b4 to VOTER
I20260809 01:58:02.322347 22224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } }
I20260809 01:58:02.322640 22309 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a902783da6646c3a5e823784f969840. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: NON_VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: true } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.322774 22309 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: LEARNER
W20260809 01:58:02.324484 21601 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 -> Peer bcb4c88ba5c443808cc80162dede835a (127.14.175.252:43265): Couldn't send request to peer bcb4c88ba5c443808cc80162dede835a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 01:58:02.324586 22278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 LEARNER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 01:58:02.324950 22225 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 01:58:02.326447 22225 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.326890 22278 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.327939 22225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.328033 22225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:02.328142 22225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.328207 22225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:02.328540 22309 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.328647 22309 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:02.340721 22231 master.cc:552] Master@127.14.175.252:43265 shutdown complete.
I20260809 01:58:02.340783 22231 master_runner.cc:305] Clearing existing system tablet
I20260809 01:58:02.341027 22231 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.341084 22231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.342396 22231 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 01:58:02.343369 22432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.343639 22231 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.343766 22231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:02.343801 22231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "bcb4c88ba5c443808cc80162dede835a"
format_stamp: "Formatted at 2026-08-09 01:58:02 on dist-test-slave-2w3w"
server_key: "2e867f1b34444cbd36187806190973c4"
server_key_iv: "37f5f3e040b30371bf314cba3b6f60f9"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.345769 22231 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:02.348171 22231 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 01:58:02.348256 22231 log.cc:1196] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 01:58:02.348507 22231 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Deleting consensus metadata
I20260809 01:58:02.348837 22231 master_runner.cc:315] Copying system tablet from 127.14.175.254:39743
I20260809 01:58:02.349970 22231 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: tablet copy: Beginning tablet copy session from remote peer at address 127.14.175.254:39743
I20260809 01:58:02.359614 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.350587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39866 (local address 127.14.175.254:39743)
0809 01:58:02.350718 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.350723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.350913 (+ 190us) server_negotiation.cc:407] Connection header received
0809 01:58:02.351109 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.351112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.351163 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.351255 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.351900 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.352828 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.354071 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.354399 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.354521 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.355866 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.355869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.355872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.355899 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.357719 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.358198 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.358202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.358204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.358297 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.358582 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.358585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.358587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.358798 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.358892 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.359280 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.359442 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:58:02.360554 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.350491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:39866)
0809 01:58:02.350812 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.350827 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.350944 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.351384 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.351387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.351609 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.351734 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.351740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.352953 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.352957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.353937 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.353948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.354526 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.354530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.354632 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.355251 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.355266 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.355701 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.357833 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.357836 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.357838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.358092 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.358393 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.358396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.358398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.358488 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.358943 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.358946 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.359084 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.360010 (+ 926us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.360164 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":88,"threads_started":1}
I20260809 01:58:02.360976 21638 tablet_copy_service.cc:140] P 0a902783da6646c3a5e823784f969840: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bcb4c88ba5c443808cc80162dede835a ({username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:39866)
I20260809 01:58:02.361076 21638 tablet_copy_service.cc:161] P 0a902783da6646c3a5e823784f969840: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bcb4c88ba5c443808cc80162dede835a at {username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:39866: session id = bcb4c88ba5c443808cc80162dede835a-00000000000000000000000000000000
I20260809 01:58:02.362152 21638 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 01:58:02.363385 22231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 01:58:02.365667 22231 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: tablet copy: Starting download of 0 data blocks...
I20260809 01:58:02.365829 22231 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: tablet copy: Starting download of 1 WAL segments...
I20260809 01:58:02.368453 22231 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 01:58:02.370164 21638 tablet_copy_service.cc:342] P 0a902783da6646c3a5e823784f969840: Request end of tablet copy session bcb4c88ba5c443808cc80162dede835a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:39866
I20260809 01:58:02.370250 21638 tablet_copy_service.cc:433] P 0a902783da6646c3a5e823784f969840: ending tablet copy session bcb4c88ba5c443808cc80162dede835a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bcb4c88ba5c443808cc80162dede835a
I20260809 01:58:02.378136 22231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.379868 22440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.379940 22443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.380098 22231 server_base.cc:1034] running on GCE node
W20260809 01:58:02.380177 22441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.380442 22231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.380733 22231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.381875 22231 hybrid_clock.cc:648] HybridClock initialized: now 1786240682381867 us; error 33 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.383656 22231 init.cc:377] Logged in from keytab as oryx/127.14.175.252@KRBTEST.COM (short username oryx)
I20260809 01:58:02.384112 22231 webserver.cc:460] Webserver started at http://127.14.175.252:40151/ using document root <none> and password file <none>
I20260809 01:58:02.384287 22231 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.384332 22231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.385716 22231 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:02.386713 22451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.387017 22231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:02.387092 22231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "bcb4c88ba5c443808cc80162dede835a"
format_stamp: "Formatted at 2026-08-09 01:58:02 on dist-test-slave-2w3w"
server_key: "2e867f1b34444cbd36187806190973c4"
server_key_iv: "37f5f3e040b30371bf314cba3b6f60f9"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.387176 22231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.410174 22231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.412571 22231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.417963 22231 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.252:43265
I20260809 01:58:02.417999 22510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.252:43265 every 8 connection(s)
I20260809 01:58:02.418571 22231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
I20260809 01:58:02.420436 22511 sys_catalog.cc:263] Verifying existing consensus state
I20260809 01:58:02.421650 22511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Bootstrap starting.
W20260809 01:58:02.424312 22426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:02.424625 22426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:02.424701 22426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:02.430256 22426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:02.430332 22426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:02.430416 22426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:02.432292 22511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 01:58:02.432603 22511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Bootstrap complete.
I20260809 01:58:02.433250 22511 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } }
I20260809 01:58:02.433394 22511 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcb4c88ba5c443808cc80162dede835a, State: Initialized, Role: LEARNER
I20260809 01:58:02.433498 22511 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } }
I20260809 01:58:02.433851 22515 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.433962 22511 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:02.434062 22515 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: LEARNER
I20260809 01:58:02.436928 22527 catalog_manager.cc:1259] Loaded cluster ID: ccb08ff55cb64b06b9ca0545f70c3730
I20260809 01:58:02.436980 22527 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: loading cluster ID for follower catalog manager: success
I20260809 01:58:02.438301 22426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:38653
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=40695
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:02.439141 22527 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: acquiring CA information for follower catalog manager: success
I20260809 01:58:02.439554 22426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:02.440481 22527 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 01:58:02.440789 22426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.450448 22531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.450524 22533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.450413 22530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.450906 22426 server_base.cc:1034] running on GCE node
I20260809 01:58:02.451308 22426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.451893 22426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.453051 22426 hybrid_clock.cc:648] HybridClock initialized: now 1786240682453039 us; error 24 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.455693 22426 init.cc:377] Logged in from keytab as oryx/127.14.175.193@KRBTEST.COM (short username oryx)
I20260809 01:58:02.456596 22426 webserver.cc:460] Webserver started at http://127.14.175.193:40695/ using document root <none> and password file <none>
I20260809 01:58:02.457118 22426 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.457209 22426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.460911 22426 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 01:58:02.462781 22541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.463985 22426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:02.464037 21963 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.464141 22426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "78a2d59953184fc39bef567b252130fe"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "96b8829422ca9ae993dbff5f9c775c46"
server_key_iv: "98c8168119b52d0ced2fde0aa082cc0d"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.464774 22426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.490767 22426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.494096 22426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:02.494261 22426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.494894 22426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:02.495769 22426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:02.495819 22426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.495858 22426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:02.495874 22426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.505091 22426 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:38653
I20260809 01:58:02.505124 22661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:38653 every 8 connection(s)
I20260809 01:58:02.506043 22426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:02.507341 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 22426
I20260809 01:58:02.507577 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21825
I20260809 01:58:02.516803 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:34553
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:39743
--webserver_port=40539
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:02.523950 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.509510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:37795 (local address 127.14.175.253:34271)
0809 01:58:02.509662 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.509667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.509685 (+ 18us) server_negotiation.cc:407] Connection header received
0809 01:58:02.510472 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.510479 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.510550 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.510647 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.512335 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.513222 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515441 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.515873 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515956 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.519554 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.519558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.519560 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.519584 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.521277 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.521998 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.522004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.522006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.522100 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.522606 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.522612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.522616 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.522849 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.522932 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.523639 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.523770 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 01:58:02.524911 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.511990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:37603 (local address 127.14.175.254:39743)
0809 01:58:02.512115 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.512120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.512377 (+ 257us) server_negotiation.cc:407] Connection header received
0809 01:58:02.512552 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.512555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.512604 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.512656 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.513180 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.513959 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515438 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.515791 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515871 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.520462 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.520469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.520474 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.520508 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.522814 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.523335 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.523338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.523340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.523428 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.523807 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.523810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.523812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.524028 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.524140 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.524658 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.524775 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:58:02.525724 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.509883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:58027 (local address 127.14.175.252:43265)
0809 01:58:02.510180 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.510186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.511000 (+ 814us) server_negotiation.cc:407] Connection header received
0809 01:58:02.511136 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.511141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.511199 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.511280 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.512336 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.513419 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515438 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.515801 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.515886 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.521270 (+ 5384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.521276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.521282 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.521316 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.523386 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.523977 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.523983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.523988 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.524081 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.524454 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.524459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.524464 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.524725 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.524830 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.525310 (+ 480us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.525458 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":94,"threads_started":1}
I20260809 01:58:02.526036 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.511650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:37603)
0809 01:58:02.512294 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.512308 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.512438 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.512784 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.512787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.512956 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.513055 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.513061 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.514101 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.514105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.515297 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.515308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.516053 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.516057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.517129 (+ 1072us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.517598 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.517612 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.520267 (+ 2655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.522942 (+ 2675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.522948 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.522950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.523219 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.523540 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.523543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.523546 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.523695 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.524191 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.524195 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.524288 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.524382 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.525253 (+ 871us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":855,"thread_start_us":75,"threads_started":1}
I20260809 01:58:02.526592 22668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.508372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.14.175.193:58027)
0809 01:58:02.510885 (+ 2513us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.510897 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.511027 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.511423 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.511426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.511650 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.512165 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.512186 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.513542 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.513545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.515297 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.515308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.516053 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.516057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.516399 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.517095 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.517120 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.521053 (+ 3933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.523525 (+ 2472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.523530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.523534 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.523835 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.524211 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.524216 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.524221 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.524326 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.524897 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.524902 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.525013 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.525119 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.526427 (+ 1308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2436,"mutex_wait_us":2525,"thread_start_us":115,"threads_started":1}
I20260809 01:58:02.526863 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.508372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.14.175.193:37795)
0809 01:58:02.509005 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.509060 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.510188 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.510835 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.510845 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.511424 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.512166 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.512188 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.513441 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.513447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.515289 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.515302 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.516142 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.516148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.516395 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.517209 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.517226 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.519385 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.521451 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.521460 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.521480 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.521864 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.522220 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.522225 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.522227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.522408 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.523018 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.523026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.523330 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.524383 (+ 1053us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.524740 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":301,"spinlock_wait_cycles":15104,"thread_start_us":138,"threads_started":1}
I20260809 01:58:02.527974 22664 heartbeater.cc:347] Connected to a master server at 127.14.175.253:34271
I20260809 01:58:02.528101 22662 heartbeater.cc:347] Connected to a master server at 127.14.175.252:43265
I20260809 01:58:02.528151 22663 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:02.528245 22663 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.528235 22664 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.528235 22662 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.528913 22664 heartbeater.cc:511] Master 127.14.175.253:34271 requested a full tablet report, sending...
I20260809 01:58:02.528913 22663 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:02.528913 22662 heartbeater.cc:511] Master 127.14.175.252:43265 requested a full tablet report, sending...
I20260809 01:58:02.530239 21615 ts_manager.cc:194] Re-registered known tserver with Master: 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
I20260809 01:58:02.530383 22259 ts_manager.cc:194] Registered new tserver with Master: 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
I20260809 01:58:02.531013 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:37603
I20260809 01:58:02.531414 22468 ts_manager.cc:194] Registered new tserver with Master: 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
W20260809 01:58:02.630445 22671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:02.630728 22671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:02.630801 22671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:02.634843 22671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:02.634922 22671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:02.635043 22671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:02.640272 22671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:34553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=40539
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:02.641204 22671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:02.642123 22671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.651208 22678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.651254 22680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.651209 22677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.651441 22671 server_base.cc:1034] running on GCE node
I20260809 01:58:02.651782 22671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.652304 22671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.653458 22671 hybrid_clock.cc:648] HybridClock initialized: now 1786240682653444 us; error 24 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.656160 22671 init.cc:377] Logged in from keytab as oryx/127.14.175.194@KRBTEST.COM (short username oryx)
I20260809 01:58:02.656998 22671 webserver.cc:460] Webserver started at http://127.14.175.194:40539/ using document root <none> and password file <none>
I20260809 01:58:02.657486 22671 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.657553 22671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.661326 22671 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:58:02.663450 22690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.664906 22671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:02.665023 22671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "71051690836247dd8e2bf70930a09d1f"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "b2a929618b6cdfb55ac457a9d5dfa796"
server_key_iv: "bee22a0aea9733a5e37785589ec26223"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.665545 22671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.676805 22671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.679615 22671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:02.679754 22671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.680213 22671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:02.680971 22671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:02.681018 22671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.681079 22671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:02.681110 22671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.681183 22111 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.690234 22671 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:34553
I20260809 01:58:02.690297 22810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:34553 every 8 connection(s)
I20260809 01:58:02.691244 22671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:02.694674 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 22671
I20260809 01:58:02.694887 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21968
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:02.707604 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:43305
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:39743
--webserver_port=37257
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 01:58:02.709970 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.692971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:43871 (local address 127.14.175.252:43265)
0809 01:58:02.693094 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.693099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.694242 (+ 1143us) server_negotiation.cc:407] Connection header received
0809 01:58:02.697281 (+ 3039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.697288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.697396 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.697464 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.699152 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.700279 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.701660 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.701984 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.702081 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.705576 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.705580 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.705595 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.705627 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.707347 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.707982 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.707985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.707987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.708083 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.708533 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.708537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.708538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.708781 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.708899 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.709616 (+ 717us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.709758 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 01:58:02.710817 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.695032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:44613 (local address 127.14.175.254:39743)
0809 01:58:02.695435 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.695438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.695452 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:02.696531 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.696537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.696614 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.696686 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.701701 (+ 5015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.702413 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.703553 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.703911 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.704001 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.706712 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.706719 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.706724 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.706756 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.708597 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.709539 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.709543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.709544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.709637 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.709946 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.709950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.709951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.710155 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.710239 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.710570 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.710684 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319}
I20260809 01:58:02.710975 22815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.693539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.14.175.194:43871)
0809 01:58:02.694076 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.694128 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.696242 (+ 2114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.697665 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.697671 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.697947 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.698981 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.698994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.700675 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.700680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.701536 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.701544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.702194 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.702197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.702293 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.702800 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.702820 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.705421 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.707461 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.707468 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.707485 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.707832 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.708189 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.708195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.708200 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.708409 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.708911 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.708920 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.709274 (+ 354us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.709552 (+ 278us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.709876 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":817,"spinlock_wait_cycles":17536,"thread_start_us":117,"threads_started":1}
I20260809 01:58:02.711583 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.694573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:44613)
0809 01:58:02.694850 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.694865 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.696416 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.697033 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.697042 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.698596 (+ 1554us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.698758 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.698771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.702551 (+ 3780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.702553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.703396 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.703410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.704177 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.704182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.704298 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.704774 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.704788 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.706546 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.709089 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.709094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.709097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.709382 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.709743 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.709746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.709748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.709837 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.710299 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.710301 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.710379 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.710985 (+ 606us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.711121 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":102,"threads_started":1}
I20260809 01:58:02.711982 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.693539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.14.175.194:48447)
0809 01:58:02.694076 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.694128 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.696248 (+ 2120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.697030 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.697039 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.697605 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.698272 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.698291 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.699358 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.699363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.700946 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.700960 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.701846 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.701853 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.702072 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.702908 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.702928 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.706148 (+ 3220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.710263 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.710266 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.710267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.710447 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.710782 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.710786 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.710789 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.710882 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.711414 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.711420 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.711519 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.711625 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.711773 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":91,"spinlock_wait_cycles":49024,"thread_start_us":133,"threads_started":1}
I20260809 01:58:02.712527 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.692987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:48447 (local address 127.14.175.253:34271)
0809 01:58:02.693095 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.693099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.694227 (+ 1128us) server_negotiation.cc:407] Connection header received
0809 01:58:02.696523 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.696529 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.696593 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.696648 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.698430 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.699190 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.701119 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.701490 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.701610 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.706719 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.706723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.706726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.706758 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.709944 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.710559 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.710564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.710568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.710667 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.711015 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.711018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.711020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.711259 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.711363 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.712190 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.712332 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 01:58:02.712641 22812 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:02.712893 22812 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.713104 22813 heartbeater.cc:347] Connected to a master server at 127.14.175.253:34271
I20260809 01:58:02.713171 22811 heartbeater.cc:347] Connected to a master server at 127.14.175.252:43265
I20260809 01:58:02.713217 22813 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.713285 22811 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.713496 22812 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:02.713600 22813 heartbeater.cc:511] Master 127.14.175.253:34271 requested a full tablet report, sending...
I20260809 01:58:02.713609 22811 heartbeater.cc:511] Master 127.14.175.252:43265 requested a full tablet report, sending...
I20260809 01:58:02.714654 21615 ts_manager.cc:194] Re-registered known tserver with Master: 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:02.714733 22259 ts_manager.cc:194] Registered new tserver with Master: 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:02.714802 22468 ts_manager.cc:194] Registered new tserver with Master: 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:02.715481 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:44613
W20260809 01:58:02.821897 22820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:02.822140 22820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:02.822211 22820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:02.826146 22820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:02.826197 22820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:02.826297 22820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:02.831617 22820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:43305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=37257
--tserver_master_addrs=127.14.175.254:39743,127.14.175.253:34271,127.14.175.252:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:02.832556 22820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:02.833489 22820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:02.843192 22830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.843259 22820 server_base.cc:1034] running on GCE node
W20260809 01:58:02.843194 22826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:02.843201 22828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:02.843825 22820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:02.844429 22820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:02.845587 22820 hybrid_clock.cc:648] HybridClock initialized: now 1786240682845572 us; error 26 us; skew 500 ppm
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:02.848631 22820 init.cc:377] Logged in from keytab as oryx/127.14.175.195@KRBTEST.COM (short username oryx)
I20260809 01:58:02.849498 22820 webserver.cc:460] Webserver started at http://127.14.175.195:37257/ using document root <none> and password file <none>
I20260809 01:58:02.850029 22820 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:02.850121 22820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:02.853698 22820 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:02.855602 22837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.856766 22820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:02.856877 22820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "dada43cb211e49f7b67effefb595971b"
format_stamp: "Formatted at 2026-08-09 01:58:01 on dist-test-slave-2w3w"
server_key: "26d4ffb9feb7d44e5de579cb3d89fae4"
server_key_iv: "cd16c8d7096b6dd692b3a952417e99f0"
server_key_version: "encryptionkey@0"
I20260809 01:58:02.857410 22820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:02.883034 22820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:02.885793 22820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:02.885936 22820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:02.886425 22820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:02.887563 22820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:02.887627 22820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.887683 22820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:02.887713 22820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:02.896903 22820 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:43305
I20260809 01:58:02.896963 22962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:43305 every 8 connection(s)
I20260809 01:58:02.897876 22820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.253@KRBTEST.COM
Aug 09 01:58:02 dist-test-slave-2w3w krb5kdc[21567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240682, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.252@KRBTEST.COM
I20260809 01:58:02.909402 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 22820
I20260809 01:58:02.913852 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.901368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:53975 (local address 127.14.175.254:39743)
0809 01:58:02.901517 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.901521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.902035 (+ 514us) server_negotiation.cc:407] Connection header received
0809 01:58:02.902237 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.902243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.902301 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.902374 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.903683 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904223 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.905398 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.905629 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.905741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.908782 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.908786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.908788 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.908811 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.910334 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.910899 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.910901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.910902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.911031 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.911828 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.911834 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.911838 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.912066 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.912185 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.913587 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.913704 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 01:58:02.914710 22969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.901260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:53975)
0809 01:58:02.901957 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.901969 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.902099 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.902509 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.902512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.902998 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.903543 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.903558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904371 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.904373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.905276 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.905285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.905776 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.905780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.905978 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.906751 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.906765 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.908611 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.910434 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.910439 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.910452 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.910800 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.911152 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.911155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.911156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.911333 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.912207 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.912213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.912515 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.912770 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.913118 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":46,"thread_start_us":64,"threads_started":1}
I20260809 01:58:02.915474 22967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.899864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.14.175.195:33401)
0809 01:58:02.900738 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.900778 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.901877 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.902460 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.902468 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.902980 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.903559 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.903568 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904647 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.904650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.905748 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.905758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.906435 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.906438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.906548 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.907127 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.907141 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.911301 (+ 4160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.913614 (+ 2313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.913619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.913623 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.913869 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.914243 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.914246 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.914248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.914342 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.914899 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.914904 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.915045 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.915163 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.915303 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":250,"spinlock_wait_cycles":36096,"thread_start_us":575,"threads_started":1}
I20260809 01:58:02.915518 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.899510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33401 (local address 127.14.175.252:43265)
0809 01:58:02.899634 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.899637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.900880 (+ 1243us) server_negotiation.cc:407] Connection header received
0809 01:58:02.902091 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.902095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.902157 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.902275 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.903706 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904510 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.905917 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.906294 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.906402 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.911424 (+ 5022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.911428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.911431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.911458 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.913232 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.913981 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.913985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.913986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.914090 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.914449 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.914452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.914454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.914710 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.914807 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.915245 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.915375 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 01:58:02.916641 22964 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39743
I20260809 01:58:02.916879 22964 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.917373 22964 heartbeater.cc:511] Master 127.14.175.254:39743 requested a full tablet report, sending...
I20260809 01:58:02.918545 22963 heartbeater.cc:347] Connected to a master server at 127.14.175.252:43265
I20260809 01:58:02.918628 22963 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.918792 22963 heartbeater.cc:511] Master 127.14.175.252:43265 requested a full tablet report, sending...
I20260809 01:58:02.919225 21615 ts_manager.cc:194] Re-registered known tserver with Master: dada43cb211e49f7b67effefb595971b (127.14.175.195:43305)
I20260809 01:58:02.919961 21615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:53975
I20260809 01:58:02.921188 22468 ts_manager.cc:194] Registered new tserver with Master: dada43cb211e49f7b67effefb595971b (127.14.175.195:43305)
I20260809 01:58:02.924476 22977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.911659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39870 (local address 127.14.175.254:39743)
0809 01:58:02.913605 (+ 1946us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.913609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.915834 (+ 2225us) server_negotiation.cc:407] Connection header received
0809 01:58:02.915942 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.915945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.915995 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.916099 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.916920 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.917629 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.918726 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.919055 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.919124 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.920803 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.920806 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.920809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.920852 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.922519 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923040 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.923133 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923468 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.923675 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.923776 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.924157 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.924289 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1863,"thread_start_us":538,"threads_started":1}
I20260809 01:58:02.924633 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.901220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:40197 (local address 127.14.175.253:34271)
0809 01:58:02.901343 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.901347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.901761 (+ 414us) server_negotiation.cc:407] Connection header received
0809 01:58:02.902108 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.902113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.902188 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.902268 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.903706 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904502 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.905897 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.906122 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.906179 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.911767 (+ 5588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.911770 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.911773 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.911798 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.913425 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.914717 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.914724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.914728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.914841 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923671 (+ 8830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.923907 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.923977 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.924362 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.924477 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:58:02.925343 22968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.901127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.14.175.195:40197)
0809 01:58:02.901668 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.901680 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.901886 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.902460 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.902468 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.902996 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:02.903561 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.903568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.904647 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.904650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.905748 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.905758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.906348 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.906352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.906467 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.906924 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:02.906943 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:02.911640 (+ 4697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:02.914314 (+ 2674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.914319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.914324 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.914581 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.923443 (+ 8862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923449 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:02.923453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:02.923545 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:02.924056 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:02.924062 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:02.924169 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.925095 (+ 926us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.925216 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":242,"spinlock_wait_cycles":4736,"thread_start_us":118,"threads_started":1}
I20260809 01:58:02.925458 22980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.913445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35860 (local address 127.14.175.252:43265)
0809 01:58:02.914074 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.914087 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.916240 (+ 2153us) server_negotiation.cc:407] Connection header received
0809 01:58:02.916276 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.916278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.916318 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.916383 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.917271 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.918013 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.919259 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.919662 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.919776 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.921579 (+ 1803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.921585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.921590 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.921620 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.923382 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923844 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923850 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923855 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.923940 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.924265 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.924269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.924270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.924499 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.924634 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.925175 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.925294 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":83,"threads_started":1}
I20260809 01:58:02.926175 22965 heartbeater.cc:347] Connected to a master server at 127.14.175.253:34271
I20260809 01:58:02.926263 22965 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:02.926440 22965 heartbeater.cc:511] Master 127.14.175.253:34271 requested a full tablet report, sending...
I20260809 01:58:02.926916 22976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.911302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43314 (local address 127.14.175.253:34271)
0809 01:58:02.911576 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.911580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.914115 (+ 2535us) server_negotiation.cc:407] Connection header received
0809 01:58:02.914165 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.914171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.914251 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.914331 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:02.915364 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.916436 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.917591 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.917914 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.917996 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.920058 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:02.920062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:02.920065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:02.920091 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:02.923041 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923520 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.923607 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:02.923902 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:02.923907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:02.923909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:02.924164 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:02.924282 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.924686 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.926769 (+ 2083us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
I20260809 01:58:02.927170 22259 ts_manager.cc:194] Registered new tserver with Master: dada43cb211e49f7b67effefb595971b (127.14.175.195:43305)
I20260809 01:58:02.927753 21615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:02.930552 21615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:02.946411 22980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.941929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35862 (local address 127.14.175.252:43265)
0809 01:58:02.942068 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.942072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.942086 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:02.942137 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.942142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.942212 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.942316 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:02.942691 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.943466 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.944917 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945608 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.945708 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.945847 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.946210 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.946294 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:58:02.946851 22989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.941317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.0.0.1:35862)
0809 01:58:02.941719 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.941735 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.941830 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.942436 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.942439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.942458 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:02.942554 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.942561 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.943604 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.943607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.944779 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.944789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945942 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.945946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.946073 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.946094 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.946628 (+ 534us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.946725 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":22,"thread_start_us":107,"threads_started":1}
I20260809 01:58:02.947593 22479 raft_consensus.cc:1203] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260809 01:58:02.948190 22991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.941327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43305 (local address 127.0.0.1:56856)
0809 01:58:02.942578 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.942593 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.942682 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.943532 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.943535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.943551 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:02.943645 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.943651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945022 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.945025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.946203 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.946212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.947697 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.947701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.947791 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.947817 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.947950 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.948048 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1183,"mutex_wait_us":3,"thread_start_us":105,"threads_started":1}
I20260809 01:58:02.948722 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.941598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56856 (local address 127.14.175.195:43305)
0809 01:58:02.942272 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.942286 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.942867 (+ 581us) server_negotiation.cc:407] Connection header received
0809 01:58:02.943034 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.943039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.943235 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.943390 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:02.943765 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.944891 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.946342 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.947568 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.947692 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.947802 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.948492 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.948589 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":113,"threads_started":1}
I20260809 01:58:02.949321 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.941903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:34553 (local address 127.0.0.1:40522)
0809 01:58:02.943019 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.943032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.943124 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.943629 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.943632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.943644 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:02.943727 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.943735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945829 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.945832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.947250 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.947260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.948929 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.948936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.949047 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.949073 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.949124 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.949203 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1033,"mutex_wait_us":61,"thread_start_us":87,"threads_started":1}
I20260809 01:58:02.950009 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.942203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40522 (local address 127.14.175.194:34553)
0809 01:58:02.942989 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.943001 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.943113 (+ 112us) server_negotiation.cc:407] Connection header received
0809 01:58:02.943220 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.943224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.943384 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.943510 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:02.943862 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945698 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.947381 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.948600 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.949605 (+ 1005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.949731 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.949779 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.949874 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":109,"threads_started":1}
I20260809 01:58:02.950791 22996 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a902783da6646c3a5e823784f969840. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:02.950925 22996 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: LEARNER
I20260809 01:58:02.951758 22889 tablet_service.cc:1467] Processing CreateTablet for tablet ef69342ec0c844308b6615a4d7ec1987 (DEFAULT_TABLE table=test-table [id=9bde700ea7ff42be9a432f84cc35a854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:02.952555 22988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.942089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:38653 (local address 127.0.0.1:60272)
0809 01:58:02.943484 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:02.943497 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:02.943597 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:02.944242 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:02.944245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:02.944261 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:02.944344 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.944349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945741 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.945744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.947029 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:02.947042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.952120 (+ 5078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.952123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:02.952214 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.952235 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 01:58:02.952345 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 01:58:02.952409 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340,"mutex_wait_us":37,"thread_start_us":91,"threads_started":1}
I20260809 01:58:02.952440 22739 tablet_service.cc:1467] Processing CreateTablet for tablet ef69342ec0c844308b6615a4d7ec1987 (DEFAULT_TABLE table=test-table [id=9bde700ea7ff42be9a432f84cc35a854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:02.952862 22889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef69342ec0c844308b6615a4d7ec1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:02.952998 22995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:02.942603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60272 (local address 127.14.175.193:38653)
0809 01:58:02.943367 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:02.943377 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:02.943688 (+ 311us) server_negotiation.cc:407] Connection header received
0809 01:58:02.943767 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:02.943771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:02.943958 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:02.944103 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:02.944464 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.945606 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.947161 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:02.951809 (+ 4648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:02.951929 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:02.952053 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:02.952764 (+ 711us) server_negotiation.cc:299] Negotiation successful
0809 01:58:02.952859 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":123,"threads_started":1}
I20260809 01:58:02.953297 22739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef69342ec0c844308b6615a4d7ec1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:02.955446 22591 tablet_service.cc:1467] Processing CreateTablet for tablet ef69342ec0c844308b6615a4d7ec1987 (DEFAULT_TABLE table=test-table [id=9bde700ea7ff42be9a432f84cc35a854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:02.956346 22591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef69342ec0c844308b6615a4d7ec1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:02.962098 23002 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Bootstrap starting.
I20260809 01:58:02.962110 23001 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Bootstrap starting.
I20260809 01:58:02.964272 23001 tablet_bootstrap.cc:654] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:02.964290 23002 tablet_bootstrap.cc:654] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:02.964540 23003 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Bootstrap starting.
I20260809 01:58:02.965111 23001 log.cc:824] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:02.965116 23002 log.cc:824] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:02.966593 23003 tablet_bootstrap.cc:654] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:02.967103 23001 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: No bootstrap required, opened a new log
I20260809 01:58:02.967119 23002 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: No bootstrap required, opened a new log
I20260809 01:58:02.967273 23001 ts_tablet_manager.cc:1397] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 01:58:02.967283 23002 ts_tablet_manager.cc:1397] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 01:58:02.967404 23003 log.cc:824] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:02.971133 23003 tablet_bootstrap.cc:492] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: No bootstrap required, opened a new log
I20260809 01:58:02.971350 23003 ts_tablet_manager.cc:1397] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 01:58:02.971267 23001 raft_consensus.cc:348] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.971524 23001 raft_consensus.cc:374] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:02.971583 23001 raft_consensus.cc:729] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71051690836247dd8e2bf70930a09d1f, State: Initialized, Role: FOLLOWER
I20260809 01:58:02.972066 23001 consensus_queue.cc:260] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.972141 23002 raft_consensus.cc:348] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.972395 23002 raft_consensus.cc:374] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:02.972452 23002 raft_consensus.cc:729] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dada43cb211e49f7b67effefb595971b, State: Initialized, Role: FOLLOWER
I20260809 01:58:02.972882 23002 consensus_queue.cc:260] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.973012 23001 ts_tablet_manager.cc:1428] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 01:58:02.973174 22812 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.973789 23002 ts_tablet_manager.cc:1428] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260809 01:58:02.975181 22964 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.975096 23003 raft_consensus.cc:348] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.975347 23003 raft_consensus.cc:374] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:02.975412 23003 raft_consensus.cc:729] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a2d59953184fc39bef567b252130fe, State: Initialized, Role: FOLLOWER
I20260809 01:58:02.975836 23003 consensus_queue.cc:260] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:02.976457 22663 heartbeater.cc:503] Master 127.14.175.254:39743 was elected leader, sending a full tablet report...
I20260809 01:58:02.976835 23003 ts_tablet_manager.cc:1428] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 01:58:03.008001 22665 tablet.cc:2369] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:03.125962 23009 raft_consensus.cc:482] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:03.126168 23009 raft_consensus.cc:504] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:03.127264 23009 leader_election.cc:288] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dada43cb211e49f7b67effefb595971b (127.14.175.195:43305), 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:03.131163 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.127662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:42333 (local address 127.14.175.195:43305)
0809 01:58:03.127797 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.127801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.128041 (+ 240us) server_negotiation.cc:407] Connection header received
0809 01:58:03.128195 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.128197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.128241 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.128329 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:03.128572 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.129060 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130131 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.130522 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130649 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.130706 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.130946 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.131038 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:58:03.131163 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.127867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:50731 (local address 127.14.175.194:34553)
0809 01:58:03.128013 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.128019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.128035 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:58:03.128097 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.128099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.128137 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.128221 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:03.128488 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.129005 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130132 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.130525 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130649 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.130707 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.130931 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.131030 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 01:58:03.131186 23010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.127544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43305 (local address 127.14.175.193:42333)
0809 01:58:03.127929 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:03.127945 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:03.128072 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:03.128341 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:03.128344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:03.128360 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:03.128463 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:03.128468 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.129167 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.129172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:03.130010 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:03.130019 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.130649 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:03.130793 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.130834 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 01:58:03.130914 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 01:58:03.131034 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":138,"thread_start_us":92,"threads_started":1}
I20260809 01:58:03.131191 23011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.127544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:34553 (local address 127.14.175.193:50731)
0809 01:58:03.127818 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:03.127836 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:03.127964 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:03.128239 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:03.128242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:03.128258 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:03.128383 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:03.128387 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.129124 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.129127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:03.130001 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:03.130018 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.130649 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.130653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:03.130810 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.130829 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 01:58:03.130916 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 01:58:03.131029 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":73,"thread_start_us":101,"threads_started":1}
I20260809 01:58:03.132097 22913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef69342ec0c844308b6615a4d7ec1987" candidate_uuid: "78a2d59953184fc39bef567b252130fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dada43cb211e49f7b67effefb595971b" is_pre_election: true
I20260809 01:58:03.132318 22761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef69342ec0c844308b6615a4d7ec1987" candidate_uuid: "78a2d59953184fc39bef567b252130fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71051690836247dd8e2bf70930a09d1f" is_pre_election: true
I20260809 01:58:03.132397 22913 raft_consensus.cc:2454] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a2d59953184fc39bef567b252130fe in term 0.
I20260809 01:58:03.132603 22761 raft_consensus.cc:2454] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a2d59953184fc39bef567b252130fe in term 0.
I20260809 01:58:03.132890 22542 leader_election.cc:302] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78a2d59953184fc39bef567b252130fe, dada43cb211e49f7b67effefb595971b; no voters:
I20260809 01:58:03.133200 23009 raft_consensus.cc:2781] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:03.133291 23009 raft_consensus.cc:482] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:03.133333 23009 raft_consensus.cc:3037] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:03.134384 23009 raft_consensus.cc:504] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:03.134774 23009 leader_election.cc:288] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [CANDIDATE]: Term 1 election: Requested vote from peers dada43cb211e49f7b67effefb595971b (127.14.175.195:43305), 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553)
I20260809 01:58:03.135088 22913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef69342ec0c844308b6615a4d7ec1987" candidate_uuid: "78a2d59953184fc39bef567b252130fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dada43cb211e49f7b67effefb595971b"
I20260809 01:58:03.135245 22913 raft_consensus.cc:3037] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:03.135394 22761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef69342ec0c844308b6615a4d7ec1987" candidate_uuid: "78a2d59953184fc39bef567b252130fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71051690836247dd8e2bf70930a09d1f"
I20260809 01:58:03.135520 22761 raft_consensus.cc:3037] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:03.136672 22913 raft_consensus.cc:2454] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a2d59953184fc39bef567b252130fe in term 1.
I20260809 01:58:03.136857 22761 raft_consensus.cc:2454] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a2d59953184fc39bef567b252130fe in term 1.
I20260809 01:58:03.136974 22542 leader_election.cc:302] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78a2d59953184fc39bef567b252130fe, dada43cb211e49f7b67effefb595971b; no voters:
I20260809 01:58:03.137177 23009 raft_consensus.cc:2781] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:03.137336 23009 raft_consensus.cc:686] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 1 LEADER]: Becoming Leader. State: Replica: 78a2d59953184fc39bef567b252130fe, State: Running, Role: LEADER
I20260809 01:58:03.137673 23009 consensus_queue.cc:237] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } }
I20260809 01:58:03.141247 21614 catalog_manager.cc:5495] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 78a2d59953184fc39bef567b252130fe (127.14.175.193). New cstate: current_term: 1 leader_uuid: "78a2d59953184fc39bef567b252130fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:03.142868 22843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: NON_VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: true } } }
I20260809 01:58:03.143019 22843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:03.144470 22982 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: attempting to promote NON_VOTER bcb4c88ba5c443808cc80162dede835a to VOTER
I20260809 01:58:03.144860 22982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } }
I20260809 01:58:03.146085 22479 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 LEARNER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 01:58:03.146689 22278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Refusing update from remote peer 0a902783da6646c3a5e823784f969840: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 01:58:03.146908 22987 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260809 01:58:03.147149 22843 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260809 01:58:03.148658 22982 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bcb4c88ba5c443808cc80162dede835a (127.14.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.149103 22278 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bcb4c88ba5c443808cc80162dede835a (127.14.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.149200 22479 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bcb4c88ba5c443808cc80162dede835a (127.14.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.150045 22982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.150146 22982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:03.150309 22982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.150399 22982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:03.150377 22843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.150454 22843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840 [sys.catalog]: This master's current role is: LEADER
W20260809 01:58:03.150641 22966 tablet.cc:2369] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:03.150684 23016 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.150794 23016 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:03.151417 22996 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a902783da6646c3a5e823784f969840" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:03.151517 22996 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:03.189474 22995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.185883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.14.175.193:38653)
0809 01:58:03.186009 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.186013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.186027 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:03.186099 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.186101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.186152 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.186240 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:03.186513 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.187111 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.187978 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.188210 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.188320 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.188638 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:03.189066 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:03.189193 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.189263 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.189322 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 01:58:03.193053 22814 tablet.cc:2369] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:03.195545 22913 raft_consensus.cc:1261] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Refusing update from remote peer 78a2d59953184fc39bef567b252130fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:03.195541 22761 raft_consensus.cc:1261] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Refusing update from remote peer 78a2d59953184fc39bef567b252130fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:03.196189 23009 consensus_queue.cc:1035] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:03.196388 23012 consensus_queue.cc:1035] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:03.205650 23020 mvcc.cc:205] Tried to move back new op lower bound from 7316441838362300416 to 7316441838134366208. Current Snapshot: MvccSnapshot[applied={T|T < 7316441838362300416}]
I20260809 01:58:03.206851 23021 mvcc.cc:205] Tried to move back new op lower bound from 7316441838362300416 to 7316441838134366208. Current Snapshot: MvccSnapshot[applied={T|T < 7316441838362300416}]
I20260809 01:58:03.209183 23019 mvcc.cc:205] Tried to move back new op lower bound from 7316441838362300416 to 7316441838134366208. Current Snapshot: MvccSnapshot[applied={T|T < 7316441838362300416}]
I20260809 01:58:03.216581 21613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:03.216751 21613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:03.222434 21613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a902783da6646c3a5e823784f969840: Sending DeleteTablet for 3 replicas of tablet ef69342ec0c844308b6615a4d7ec1987
I20260809 01:58:03.223435 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet ef69342ec0c844308b6615a4d7ec1987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:03 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:56856
I20260809 01:58:03.223858 22591 tablet_service.cc:1514] Processing DeleteTablet for tablet ef69342ec0c844308b6615a4d7ec1987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:03 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:60272
I20260809 01:58:03.224090 23029 tablet_replica.cc:330] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: stopping tablet replica
I20260809 01:58:03.224524 23029 raft_consensus.cc:2229] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:03.224962 23029 raft_consensus.cc:2258] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:03.225589 23030 tablet_replica.cc:330] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: stopping tablet replica
I20260809 01:58:03.225906 23030 raft_consensus.cc:2229] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:03.226305 23030 raft_consensus.cc:2258] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:03.227039 23029 ts_tablet_manager.cc:1905] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:03.227761 23030 ts_tablet_manager.cc:1905] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:03.228927 22739 tablet_service.cc:1514] Processing DeleteTablet for tablet ef69342ec0c844308b6615a4d7ec1987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:03 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:40522
I20260809 01:58:03.229677 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 21582
I20260809 01:58:03.232021 23030 ts_tablet_manager.cc:1918] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:03.232123 23030 log.cc:1196] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/ef69342ec0c844308b6615a4d7ec1987
I20260809 01:58:03.232465 23030 ts_tablet_manager.cc:1939] T ef69342ec0c844308b6615a4d7ec1987 P 78a2d59953184fc39bef567b252130fe: Deleting consensus metadata
I20260809 01:58:03.233635 23029 ts_tablet_manager.cc:1918] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:03.234108 23029 log.cc:1196] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/ef69342ec0c844308b6615a4d7ec1987
I20260809 01:58:03.234560 23029 ts_tablet_manager.cc:1939] T ef69342ec0c844308b6615a4d7ec1987 P dada43cb211e49f7b67effefb595971b: Deleting consensus metadata
I20260809 01:58:03.236034 23032 tablet_replica.cc:330] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: stopping tablet replica
I20260809 01:58:03.236449 23032 raft_consensus.cc:2229] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:03.236860 23032 raft_consensus.cc:2258] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:03.238947 23032 ts_tablet_manager.cc:1905] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 01:58:03.240490 22545 connection.cc:535] server connection from 127.0.0.1:60272 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 01:58:03.241143 22838 connection.cc:535] server connection from 127.0.0.1:56856 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 01:58:03.243084 23032 ts_tablet_manager.cc:1918] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:03.243271 22976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.227394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43320 (local address 127.14.175.253:34271)
0809 01:58:03.227522 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.227526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.229377 (+ 1851us) server_negotiation.cc:407] Connection header received
0809 01:58:03.229612 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.229615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.229690 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.229753 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:03.234059 (+ 4306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.234951 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.236264 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.236626 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.236703 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.238667 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:03.238671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:03.238674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:03.238701 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:03.241289 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.241789 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.241793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.241795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.241891 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.242196 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.242200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.242201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.242413 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:03.242559 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.242945 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.243099 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 01:58:03.243270 23032 log.cc:1196] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/ef69342ec0c844308b6615a4d7ec1987
I20260809 01:58:03.243889 23032 ts_tablet_manager.cc:1939] T ef69342ec0c844308b6615a4d7ec1987 P 71051690836247dd8e2bf70930a09d1f: Deleting consensus metadata
W20260809 01:58:03.245484 22694 connection.cc:441] server connection from 127.0.0.1:40522 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40522 (request call id 1) could send its response
I20260809 01:58:03.255612 22980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.227520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.14.175.252:43265)
0809 01:58:03.227639 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.227643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.244045 (+ 16402us) server_negotiation.cc:407] Connection header received
0809 01:58:03.244223 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.244226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.244277 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.244341 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:03.245420 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.247791 (+ 2371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.249090 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.249440 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.249526 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.251309 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:03.251312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:03.251315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:03.251355 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:03.253214 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.253852 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.253855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.253857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.253941 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.254634 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.254637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.254639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.254855 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:03.254983 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.255324 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.255453 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 01:58:03.262120 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.248763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.14.175.252:43265)
0809 01:58:03.248875 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.248879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.252292 (+ 3413us) server_negotiation.cc:407] Connection header received
0809 01:58:03.252335 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.252337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.252385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.252474 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:03.253796 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.254507 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.255750 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.256098 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.256169 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.257983 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:03.257986 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:03.257989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:03.258014 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:03.259966 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.260568 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.260573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.260576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.260661 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.260998 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.261005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.261008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.261239 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:03.261361 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.261839 (+ 478us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.261951 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 01:58:03.263739 22976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:03.248078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.14.175.253:34271)
0809 01:58:03.248180 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:03.248184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:03.249425 (+ 1241us) server_negotiation.cc:407] Connection header received
0809 01:58:03.249594 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:03.249597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:03.249645 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:03.249694 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:03.251287 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.252121 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.255315 (+ 3194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:03.255626 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:03.255705 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:03.259925 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:03.259929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:03.259932 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:03.259957 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:03.261714 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.262189 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.262193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.262194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.262286 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:03.262662 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:03.262666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:03.262671 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:03.262892 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:03.263151 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:03.263490 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 01:58:03.263600 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 01:58:04.210181 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.209640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:47879)
0809 01:58:04.209949 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.210071 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":86,"threads_started":1}
I20260809 01:58:04.210366 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.209869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:38603)
0809 01:58:04.210176 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.210268 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":59,"threads_started":1}
W20260809 01:58:04.210580 22663 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:39743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
W20260809 01:58:04.210731 22812 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:39743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.210840 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.210382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:55993)
0809 01:58:04.210656 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.210741 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":63,"threads_started":1}
W20260809 01:58:04.211126 22964 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:39743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.722724 23043 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a902783da6646c3a5e823784f969840)
I20260809 01:58:04.723023 23043 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } }
I20260809 01:58:04.723874 23044 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a902783da6646c3a5e823784f969840)
I20260809 01:58:04.724115 23043 leader_election.cc:288] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743), b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253:34271)
I20260809 01:58:04.724078 23044 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } }
I20260809 01:58:04.724840 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.724272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40328)
0809 01:58:04.724623 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.724714 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":81,"threads_started":1}
W20260809 01:58:04.725042 22455 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.725955 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.725679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40354)
0809 01:58:04.725822 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.725887 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 01:58:04.726060 22455 leader_election.cc:334] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743): Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.726477 23044 leader_election.cc:288] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743), bcb4c88ba5c443808cc80162dede835a (127.14.175.252:43265)
I20260809 01:58:04.726953 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.726580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40364)
0809 01:58:04.726798 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.726867 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":70,"threads_started":1}
W20260809 01:58:04.727149 22253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.728011 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.727746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40368)
0809 01:58:04.727872 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.727934 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 01:58:04.728170 22253 leader_election.cc:334] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743): Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.729660 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.724374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:34271 (local address 127.0.0.1:43340)
0809 01:58:04.724623 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.724640 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:04.724754 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:04.725829 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:04.725833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:04.725852 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:04.725986 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.725994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.727295 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.727300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.728553 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.728563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.729232 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.729235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.729331 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.729354 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:58:04.729455 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 01:58:04.729539 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":109,"threads_started":1}
I20260809 01:58:04.729669 23048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.724747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43340 (local address 127.14.175.253:34271)
0809 01:58:04.725569 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:04.725574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:04.725590 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:58:04.725641 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:04.725646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:04.725696 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:04.726238 (+ 542us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:04.726344 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.727165 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.728673 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.729107 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.729231 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.729283 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:04.729471 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 01:58:04.729546 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":69,"threads_started":1}
I20260809 01:58:04.730189 22278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcb4c88ba5c443808cc80162dede835a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" is_pre_election: true
I20260809 01:58:04.730396 22278 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcb4c88ba5c443808cc80162dede835a in term 1.
I20260809 01:58:04.730773 22454 leader_election.cc:302] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8b9c6c4b3744addb88b118cdb3bd0b4, bcb4c88ba5c443808cc80162dede835a; no voters: 0a902783da6646c3a5e823784f969840
I20260809 01:58:04.730947 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.726890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:43265 (local address 127.0.0.1:35884)
0809 01:58:04.727108 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.727120 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:04.727208 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:04.727650 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:04.727653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:04.727670 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:04.727760 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.727764 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.728693 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.728697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.729491 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.729500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.730560 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.730564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.730668 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.730694 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:58:04.730762 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 01:58:04.730819 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":80,"threads_started":1}
I20260809 01:58:04.731070 23043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 01:58:04.731150 23043 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a902783da6646c3a5e823784f969840)
I20260809 01:58:04.731205 23043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 1 FOLLOWER]: Advancing to term 2
I20260809 01:58:04.732286 23043 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } }
I20260809 01:58:04.731068 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.727046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35884 (local address 127.14.175.252:43265)
0809 01:58:04.727411 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:04.727420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:04.727435 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:04.727478 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:04.727484 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:04.727532 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:04.727640 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:04.727918 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.728582 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.729610 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.730403 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.730532 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.730583 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:04.730859 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 01:58:04.730937 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":91,"threads_started":1}
I20260809 01:58:04.732686 23043 leader_election.cc:288] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 election: Requested vote from peers 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743), b8b9c6c4b3744addb88b118cdb3bd0b4 (127.14.175.253:34271)
I20260809 01:58:04.732806 22479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bcb4c88ba5c443808cc80162dede835a" is_pre_election: true
I20260809 01:58:04.732962 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.732772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40378)
0809 01:58:04.732856 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.732909 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 01:58:04.733017 22479 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8b9c6c4b3744addb88b118cdb3bd0b4 in current term 2: Already voted for candidate bcb4c88ba5c443808cc80162dede835a in this term.
I20260809 01:58:04.733177 22278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcb4c88ba5c443808cc80162dede835a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4"
I20260809 01:58:04.733299 22278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260809 01:58:04.733636 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.733426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40382)
0809 01:58:04.733525 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.733577 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 01:58:04.733664 22253 leader_election.cc:302] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8b9c6c4b3744addb88b118cdb3bd0b4; no voters: 0a902783da6646c3a5e823784f969840, bcb4c88ba5c443808cc80162dede835a
W20260809 01:58:04.733986 22455 leader_election.cc:334] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743): Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
I20260809 01:58:04.734429 22278 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcb4c88ba5c443808cc80162dede835a in term 2.
I20260809 01:58:04.734550 23044 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 01:58:04.734776 22454 leader_election.cc:302] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8b9c6c4b3744addb88b118cdb3bd0b4, bcb4c88ba5c443808cc80162dede835a; no voters: 0a902783da6646c3a5e823784f969840
I20260809 01:58:04.734930 23043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 2 FOLLOWER]: Leader election won for term 2
I20260809 01:58:04.735154 23043 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [term 2 LEADER]: Becoming Leader. State: Replica: bcb4c88ba5c443808cc80162dede835a, State: Running, Role: LEADER
I20260809 01:58:04.735416 23043 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } }
I20260809 01:58:04.736305 23057 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcb4c88ba5c443808cc80162dede835a. Latest consensus state: current_term: 2 leader_uuid: "bcb4c88ba5c443808cc80162dede835a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:04.736433 23057 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:04.736718 23059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:04.739029 23059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:04.739404 23059 catalog_manager.cc:1259] Loaded cluster ID: ccb08ff55cb64b06b9ca0545f70c3730
I20260809 01:58:04.739452 23059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:04.739996 23059 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:04.740386 23059 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Loaded TSK: 0
I20260809 01:58:04.741060 23059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:58:04.786463 22468 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:04.789762 22468 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:04.792757 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.792509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40398)
0809 01:58:04.792621 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.792695 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 01:58:04.792867 22278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [term 2 FOLLOWER]: Refusing update from remote peer bcb4c88ba5c443808cc80162dede835a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 01:58:04.793414 23057 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 01:58:04.793543 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.793245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.0.0.1:40414)
0809 01:58:04.793355 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.793418 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 01:58:04.793645 22455 consensus_peers.cc:487] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a -> Peer 0a902783da6646c3a5e823784f969840 (127.14.175.254:39743): Couldn't send request to peer 0a902783da6646c3a5e823784f969840. Status: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 01:58:04.794937 23044 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcb4c88ba5c443808cc80162dede835a. Latest consensus state: current_term: 2 leader_uuid: "bcb4c88ba5c443808cc80162dede835a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:04.795109 23044 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:04.796262 23043 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "bcb4c88ba5c443808cc80162dede835a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:04.796392 23043 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:04.796644 23044 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "bcb4c88ba5c443808cc80162dede835a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0a902783da6646c3a5e823784f969840" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39743 } } peers { permanent_uuid: "b8b9c6c4b3744addb88b118cdb3bd0b4" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 34271 } attrs { promote: false } } peers { permanent_uuid: "bcb4c88ba5c443808cc80162dede835a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 43265 } attrs { promote: false } } }
I20260809 01:58:04.796757 23044 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b9c6c4b3744addb88b118cdb3bd0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 01:58:04.807639 23047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.802492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43305 (local address 127.0.0.1:56858)
0809 01:58:04.802637 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.802651 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:04.802726 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:04.803558 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:04.803562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:04.803581 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:04.803707 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.803716 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.804812 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.804815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.806251 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.806261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807296 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.807300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.807382 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.807414 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 01:58:04.807458 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 01:58:04.807509 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":117}
I20260809 01:58:04.807683 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.803104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.14.175.194:34553)
0809 01:58:04.803338 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:04.803344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:04.803363 (+ 19us) server_negotiation.cc:407] Connection header received
0809 01:58:04.803417 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:04.803420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:04.803462 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:04.803566 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:04.803864 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.804599 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.806383 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807068 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.807191 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.807263 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:04.807451 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 01:58:04.807539 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":95,"threads_started":1}
I20260809 01:58:04.807638 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.802809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:34553 (local address 127.0.0.1:40532)
0809 01:58:04.802921 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.802939 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:04.803312 (+ 373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:04.803577 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:04.803580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:04.803598 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:04.803728 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.803735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.804746 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.804749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.806252 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.806261 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807188 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.807193 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.807322 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.807348 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:58:04.807423 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 01:58:04.807497 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":170}
I20260809 01:58:04.808050 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.803458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.14.175.193:38653)
0809 01:58:04.804120 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:04.804125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:04.804138 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:58:04.804329 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:04.804333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:04.804382 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:04.804469 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:04.804700 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.805289 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.806540 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807183 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.807285 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.807328 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:04.807757 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 01:58:04.807945 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":78,"threads_started":1}
I20260809 01:58:04.808363 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.802637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.14.175.195:43305)
0809 01:58:04.803278 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:04.803295 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:04.803312 (+ 17us) server_negotiation.cc:407] Connection header received
0809 01:58:04.803365 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:04.803371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:04.803424 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:04.803833 (+ 409us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:04.803975 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.804704 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.806529 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807172 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.808050 (+ 878us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.808110 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:04.808144 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 01:58:04.808221 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":79,"threads_started":1}
I20260809 01:58:04.808457 22739 tablet_service.cc:1467] Processing CreateTablet for tablet ec7b9edc75df447482dce71c39f0fc90 (DEFAULT_TABLE table=test-table [id=e1cdfec2fd3e474bafe3380f906aed8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:04.808636 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.803097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:38653 (local address 127.0.0.1:60294)
0809 01:58:04.803836 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.803850 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:04.804199 (+ 349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:04.804491 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:04.804494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:04.804511 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:04.804588 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.804592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.805409 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.805413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.806404 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:04.806414 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:04.807389 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:04.807411 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:04.807503 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:04.807527 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 01:58:04.807600 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 01:58:04.807668 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":157,"thread_start_us":99,"threads_started":1}
I20260809 01:58:04.808797 22739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec7b9edc75df447482dce71c39f0fc90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:04.808899 22889 tablet_service.cc:1467] Processing CreateTablet for tablet ec7b9edc75df447482dce71c39f0fc90 (DEFAULT_TABLE table=test-table [id=e1cdfec2fd3e474bafe3380f906aed8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:04.809151 22889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec7b9edc75df447482dce71c39f0fc90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:04.811543 23070 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Bootstrap starting.
I20260809 01:58:04.811653 23071 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Bootstrap starting.
I20260809 01:58:04.811767 22591 tablet_service.cc:1467] Processing CreateTablet for tablet ec7b9edc75df447482dce71c39f0fc90 (DEFAULT_TABLE table=test-table [id=e1cdfec2fd3e474bafe3380f906aed8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:04.812065 22591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec7b9edc75df447482dce71c39f0fc90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:04.812615 23070 tablet_bootstrap.cc:654] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:04.812759 23071 tablet_bootstrap.cc:654] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:04.814059 23071 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: No bootstrap required, opened a new log
I20260809 01:58:04.814131 23071 ts_tablet_manager.cc:1397] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 01:58:04.814503 23074 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe: Bootstrap starting.
I20260809 01:58:04.814517 23071 raft_consensus.cc:348] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.814625 23071 raft_consensus.cc:374] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:04.814664 23071 raft_consensus.cc:729] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dada43cb211e49f7b67effefb595971b, State: Initialized, Role: FOLLOWER
I20260809 01:58:04.814833 23071 consensus_queue.cc:260] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.815228 23071 ts_tablet_manager.cc:1428] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:04.815438 23070 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: No bootstrap required, opened a new log
I20260809 01:58:04.815497 23070 ts_tablet_manager.cc:1397] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 01:58:04.815933 23070 raft_consensus.cc:348] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.816048 23070 raft_consensus.cc:374] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:04.816080 23070 raft_consensus.cc:729] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71051690836247dd8e2bf70930a09d1f, State: Initialized, Role: FOLLOWER
I20260809 01:58:04.816211 23070 consensus_queue.cc:260] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.816581 23070 ts_tablet_manager.cc:1428] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:04.817564 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.817141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:36059)
0809 01:58:04.817376 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.817449 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260809 01:58:04.817795 23074 tablet_bootstrap.cc:654] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:04.818388 22963 heartbeater.cc:503] Master 127.14.175.252:43265 was elected leader, sending a full tablet report...
I20260809 01:58:04.818608 22811 heartbeater.cc:503] Master 127.14.175.252:43265 was elected leader, sending a full tablet report...
I20260809 01:58:04.819079 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.818843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:48163)
0809 01:58:04.818948 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.819018 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 01:58:04.819203 23079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.818047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:41025)
0809 01:58:04.819050 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.819105 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":936,"thread_start_us":92,"threads_started":1}
I20260809 01:58:04.820278 23074 tablet_bootstrap.cc:492] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe: No bootstrap required, opened a new log
I20260809 01:58:04.820385 23074 ts_tablet_manager.cc:1397] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260809 01:58:04.820760 23074 raft_consensus.cc:348] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.820871 23074 raft_consensus.cc:374] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:04.820915 23074 raft_consensus.cc:729] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a2d59953184fc39bef567b252130fe, State: Initialized, Role: FOLLOWER
I20260809 01:58:04.821053 23074 consensus_queue.cc:260] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:04.821645 23074 ts_tablet_manager.cc:1428] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 01:58:04.822046 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.821667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:55085)
0809 01:58:04.821881 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.821941 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":109,"threads_started":1}
I20260809 01:58:04.822861 22662 heartbeater.cc:503] Master 127.14.175.252:43265 was elected leader, sending a full tablet report...
I20260809 01:58:04.823045 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:04.822479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:51989)
0809 01:58:04.822870 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:04.822937 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":89,"threads_started":1}
I20260809 01:58:05.019994 23075 raft_consensus.cc:482] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:05.020183 23075 raft_consensus.cc:504] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:05.021229 23075 leader_election.cc:288] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553), 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
I20260809 01:58:05.025799 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.021633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:54795 (local address 127.14.175.194:34553)
0809 01:58:05.021771 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:05.021775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:05.022162 (+ 387us) server_negotiation.cc:407] Connection header received
0809 01:58:05.022229 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:05.022234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:05.022294 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:05.022385 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:05.022788 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.023615 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.024799 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.025202 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.025335 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:05.025389 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:05.025579 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 01:58:05.025657 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:58:05.025871 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.021749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:42401 (local address 127.14.175.193:38653)
0809 01:58:05.021908 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:05.021914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:05.021929 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:05.021984 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:05.021987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:05.022208 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:05.022321 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:05.022784 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.023615 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.024811 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.025216 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.025353 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:05.025404 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:05.025629 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 01:58:05.025706 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 01:58:05.025858 23079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.021526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:38653 (local address 127.14.175.195:42401)
0809 01:58:05.021678 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.021698 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:05.021828 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:05.022409 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:05.022412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:05.022446 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:05.022634 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:05.022640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.023739 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.023744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:05.024675 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:05.024684 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.025358 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.025362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:05.025499 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:05.025517 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 01:58:05.025604 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 01:58:05.025677 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":99,"spinlock_wait_cycles":5760}
I20260809 01:58:05.025874 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.021526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:34553 (local address 127.14.175.195:54795)
0809 01:58:05.022027 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.022039 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:05.022140 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:05.022409 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:05.022412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:05.022448 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:05.022632 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:05.022640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.023779 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.023782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:05.024667 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:05.024676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.025327 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.025331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:05.025433 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:05.025469 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 01:58:05.025549 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 01:58:05.025619 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":182,"spinlock_wait_cycles":11136,"thread_start_us":216,"threads_started":1}
I20260809 01:58:05.026396 22761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec7b9edc75df447482dce71c39f0fc90" candidate_uuid: "dada43cb211e49f7b67effefb595971b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71051690836247dd8e2bf70930a09d1f" is_pre_election: true
I20260809 01:58:05.026561 22761 raft_consensus.cc:2454] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dada43cb211e49f7b67effefb595971b in term 0.
I20260809 01:58:05.026499 22612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec7b9edc75df447482dce71c39f0fc90" candidate_uuid: "dada43cb211e49f7b67effefb595971b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a2d59953184fc39bef567b252130fe" is_pre_election: true
I20260809 01:58:05.026778 22612 raft_consensus.cc:2454] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dada43cb211e49f7b67effefb595971b in term 0.
I20260809 01:58:05.027050 22841 leader_election.cc:302] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71051690836247dd8e2bf70930a09d1f, dada43cb211e49f7b67effefb595971b; no voters:
I20260809 01:58:05.027351 23075 raft_consensus.cc:2781] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:05.027417 23075 raft_consensus.cc:482] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:05.027454 23075 raft_consensus.cc:3037] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:05.028491 23075 raft_consensus.cc:504] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:05.028883 23075 leader_election.cc:288] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [CANDIDATE]: Term 1 election: Requested vote from peers 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553), 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653)
I20260809 01:58:05.029232 22761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec7b9edc75df447482dce71c39f0fc90" candidate_uuid: "dada43cb211e49f7b67effefb595971b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71051690836247dd8e2bf70930a09d1f"
I20260809 01:58:05.029266 22612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec7b9edc75df447482dce71c39f0fc90" candidate_uuid: "dada43cb211e49f7b67effefb595971b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a2d59953184fc39bef567b252130fe"
I20260809 01:58:05.029361 22761 raft_consensus.cc:3037] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:05.029395 22612 raft_consensus.cc:3037] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:05.030316 22761 raft_consensus.cc:2454] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dada43cb211e49f7b67effefb595971b in term 1.
I20260809 01:58:05.030457 22612 raft_consensus.cc:2454] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dada43cb211e49f7b67effefb595971b in term 1.
I20260809 01:58:05.030586 22841 leader_election.cc:302] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71051690836247dd8e2bf70930a09d1f, dada43cb211e49f7b67effefb595971b; no voters:
I20260809 01:58:05.030766 23075 raft_consensus.cc:2781] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:05.031049 23075 raft_consensus.cc:686] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 1 LEADER]: Becoming Leader. State: Replica: dada43cb211e49f7b67effefb595971b, State: Running, Role: LEADER
I20260809 01:58:05.031334 23075 consensus_queue.cc:237] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } }
I20260809 01:58:05.031749 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.031528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:37513)
0809 01:58:05.031626 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.031680 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 01:58:05.033655 22468 catalog_manager.cc:5495] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b reported cstate change: term changed from 0 to 1, leader changed from <none> to dada43cb211e49f7b67effefb595971b (127.14.175.195). New cstate: current_term: 1 leader_uuid: "dada43cb211e49f7b67effefb595971b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dada43cb211e49f7b67effefb595971b" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:05.098287 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.094739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.14.175.195:43305)
0809 01:58:05.094908 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:05.094914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:05.094948 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:58:05.095055 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:05.095057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:05.095133 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:05.095254 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:05.095505 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.096022 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.096885 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:05.097106 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:05.097214 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:05.097490 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:05.097901 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:05.098021 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:05.098082 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 01:58:05.098139 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:58:05.101161 22761 raft_consensus.cc:1261] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Refusing update from remote peer dada43cb211e49f7b67effefb595971b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:05.101367 22612 raft_consensus.cc:1261] T ec7b9edc75df447482dce71c39f0fc90 P 78a2d59953184fc39bef567b252130fe [term 1 FOLLOWER]: Refusing update from remote peer dada43cb211e49f7b67effefb595971b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:05.101711 23086 consensus_queue.cc:1035] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71051690836247dd8e2bf70930a09d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 34553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:05.101974 23075 consensus_queue.cc:1035] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78a2d59953184fc39bef567b252130fe" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:05.104099 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.103851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:35733)
0809 01:58:05.103949 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.104010 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 01:58:05.104506 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.104120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:57123)
0809 01:58:05.104371 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.104426 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173}
I20260809 01:58:05.107424 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.106952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:42655)
0809 01:58:05.107276 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.107347 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233}
I20260809 01:58:05.109812 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.109572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.195:48275)
0809 01:58:05.109691 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.109747 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 01:58:05.109880 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.109606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.193:42859)
0809 01:58:05.109752 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.109809 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 01:58:05.111685 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.111424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39743 (local address 127.14.175.194:43341)
0809 01:58:05.111529 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.111588 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:39743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 01:58:05.117017 22467 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:05.117204 22467 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:05.120966 22467 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bcb4c88ba5c443808cc80162dede835a: Sending DeleteTablet for 3 replicas of tablet ec7b9edc75df447482dce71c39f0fc90
I20260809 01:58:05.121635 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet ec7b9edc75df447482dce71c39f0fc90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:05 UTC) from {username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:56858
I20260809 01:58:05.122335 22591 tablet_service.cc:1514] Processing DeleteTablet for tablet ec7b9edc75df447482dce71c39f0fc90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:05 UTC) from {username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:60294
I20260809 01:58:05.122752 22739 tablet_service.cc:1514] Processing DeleteTablet for tablet ec7b9edc75df447482dce71c39f0fc90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:05 UTC) from {username='oryx', principal='oryx/127.14.175.252@KRBTEST.COM'} at 127.0.0.1:40532
I20260809 01:58:05.122809 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 22426
I20260809 01:58:05.124420 23100 tablet_replica.cc:330] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: stopping tablet replica
I20260809 01:58:05.124609 23100 raft_consensus.cc:2229] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:05.124954 23100 raft_consensus.cc:2258] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:05.125264 23103 tablet_replica.cc:330] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: stopping tablet replica
I20260809 01:58:05.125447 23103 raft_consensus.cc:2229] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:05.125602 23103 raft_consensus.cc:2258] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:05.126477 23103 ts_tablet_manager.cc:1905] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:05.130213 23103 ts_tablet_manager.cc:1918] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:05.130326 23103 log.cc:1196] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/ec7b9edc75df447482dce71c39f0fc90
I20260809 01:58:05.130700 23103 ts_tablet_manager.cc:1939] T ec7b9edc75df447482dce71c39f0fc90 P 71051690836247dd8e2bf70930a09d1f: Deleting consensus metadata
I20260809 01:58:05.131508 22454 catalog_manager.cc:4841] TS 71051690836247dd8e2bf70930a09d1f (127.14.175.194:34553): tablet ec7b9edc75df447482dce71c39f0fc90 (table test-table [id=e1cdfec2fd3e474bafe3380f906aed8e]) successfully deleted
I20260809 01:58:05.131585 23100 ts_tablet_manager.cc:1905] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:05.134104 23100 ts_tablet_manager.cc:1918] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:05.134188 23100 log.cc:1196] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/ec7b9edc75df447482dce71c39f0fc90
I20260809 01:58:05.134527 23100 ts_tablet_manager.cc:1939] T ec7b9edc75df447482dce71c39f0fc90 P dada43cb211e49f7b67effefb595971b: Deleting consensus metadata
I20260809 01:58:05.135298 22452 catalog_manager.cc:4841] TS dada43cb211e49f7b67effefb595971b (127.14.175.195:43305): tablet ec7b9edc75df447482dce71c39f0fc90 (table test-table [id=e1cdfec2fd3e474bafe3380f906aed8e]) successfully deleted
I20260809 01:58:05.141538 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 22671
I20260809 01:58:05.141920 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:05.141574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:38653 (local address 127.0.0.1:60304)
0809 01:58:05.141737 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:05.141812 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:38653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 01:58:05.146317 22453 catalog_manager.cc:4584] TS 78a2d59953184fc39bef567b252130fe (127.14.175.193:38653): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec7b9edc75df447482dce71c39f0fc90: Network error: Client connection negotiation failed: client connection to 127.14.175.193:38653: connect: Connection refused (error 111)
I20260809 01:58:05.151644 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 22820
I20260809 01:58:05.158354 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 22118
I20260809 01:58:05.164665 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 22231
2026-08-09T01:58:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5588 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:58:05 dist-test-slave-2w3w krb5kdc[23106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:58:05 dist-test-slave-2w3w krb5kdc[23106](info): set up 2 sockets
Aug 09 01:58:05 dist-test-slave-2w3w krb5kdc[23106](info): commencing operation
krb5kdc: starting...
W20260809 01:58:06.245136 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab.
Entry for principal oryx/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab.
I20260809 01:58:06.367779 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33067
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab
--principal=oryx/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:33067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:06.476987 23119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:06.477218 23119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:06.477254 23119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:06.481160 23119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:06.481213 23119 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 01:58:06.481230 23119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:06.481248 23119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:06.481264 23119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:06.481279 23119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:06.486477 23119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:33067
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.254.keytab
--principal=oryx/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:06.487496 23119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:06.488523 23119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 01:58:06.496917 23119 server_base.cc:1034] running on GCE node
W20260809 01:58:06.496832 23124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.496845 23125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.496866 23127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:06.497752 23119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:06.498724 23119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:06.499913 23119 hybrid_clock.cc:648] HybridClock initialized: now 1786240686499891 us; error 46 us; skew 500 ppm
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:06.502530 23119 init.cc:377] Logged in from keytab as oryx/127.14.175.254@KRBTEST.COM (short username oryx)
I20260809 01:58:06.503461 23119 webserver.cc:460] Webserver started at http://127.14.175.254:39005/ using document root <none> and password file <none>
I20260809 01:58:06.503996 23119 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:06.504087 23119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:06.504285 23119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:06.506229 23119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "e2d4b15911b14705abacc21e76c26a8e"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "aad731f579c3ca24890f3e72efdf3e26"
server_key_iv: "e7cbc71414d7f3817f1bb0cfd7890ae9"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.506788 23119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "e2d4b15911b14705abacc21e76c26a8e"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "aad731f579c3ca24890f3e72efdf3e26"
server_key_iv: "e7cbc71414d7f3817f1bb0cfd7890ae9"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.510437 23119 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:06.512737 23134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:06.513803 23119 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:06.513952 23119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "e2d4b15911b14705abacc21e76c26a8e"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "aad731f579c3ca24890f3e72efdf3e26"
server_key_iv: "e7cbc71414d7f3817f1bb0cfd7890ae9"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.514055 23119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:06.522423 23119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:06.525007 23119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:06.525192 23119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:06.532989 23119 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:33067
I20260809 01:58:06.533015 23201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:33067 every 8 connection(s)
I20260809 01:58:06.533844 23119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:06.536458 23202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:06.541644 23202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Bootstrap starting.
I20260809 01:58:06.543642 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23119
I20260809 01:58:06.543778 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:06.544095 15039 external_mini_cluster.cc:1428] Setting key 80fd1bdf53e9e00ea3251458c5f5140c
I20260809 01:58:06.544283 23202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:06.545095 23202 log.cc:824] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:06.547176 23202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: No bootstrap required, opened a new log
I20260809 01:58:06.550513 23202 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } }
I20260809 01:58:06.550747 23202 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:06.550808 23202 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d4b15911b14705abacc21e76c26a8e, State: Initialized, Role: FOLLOWER
I20260809 01:58:06.551285 23202 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } }
I20260809 01:58:06.551436 23202 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:06.551530 23202 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:06.551648 23202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:06.552670 23202 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } }
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:06.553030 23202 leader_election.cc:302] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2d4b15911b14705abacc21e76c26a8e; no voters:
I20260809 01:58:06.553377 23202 leader_election.cc:288] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:06.553503 23207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:06.553747 23207 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [term 1 LEADER]: Becoming Leader. State: Replica: e2d4b15911b14705abacc21e76c26a8e, State: Running, Role: LEADER
I20260809 01:58:06.554067 23207 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } }
I20260809 01:58:06.554692 23202 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:06.555823 23210 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2d4b15911b14705abacc21e76c26a8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } } }
I20260809 01:58:06.555958 23210 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:06.556216 23209 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2d4b15911b14705abacc21e76c26a8e. Latest consensus state: current_term: 1 leader_uuid: "e2d4b15911b14705abacc21e76c26a8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d4b15911b14705abacc21e76c26a8e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33067 } } }
I20260809 01:58:06.556318 23209 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:06.559152 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:06.545287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.14.175.254:33067)
0809 01:58:06.545684 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:06.545704 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:06.545745 (+ 41us) server_negotiation.cc:407] Connection header received
0809 01:58:06.546439 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:06.546454 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:06.546817 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:06.547184 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:06.547987 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.548985 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.549846 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.550333 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.550505 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:06.553598 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:06.553605 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:06.553621 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:06.553654 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:06.555974 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.556469 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.556476 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.556484 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.556625 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.556968 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.556971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.556973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.557441 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:06.557638 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:06.557950 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 01:58:06.558234 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":104,"threads_started":1}
W20260809 01:58:06.559599 23226 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:06.559693 23226 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:06.559760 23218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:06.560487 23218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:06.566218 23218 catalog_manager.cc:1347] Generated new cluster ID: 7b72a1e4dbb146c7a122dd5f8768be6a
I20260809 01:58:06.566289 23218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:06.582510 23218 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:06.583640 23218 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:06.589959 23218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Generated new TSK 0
I20260809 01:58:06.590576 23218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
I20260809 01:58:06.620081 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33067
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:06.729578 23232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:06.729807 23232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:06.729856 23232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:06.733705 23232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:06.733750 23232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:06.733804 23232 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:58:06.733851 23232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:06.738708 23232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:33067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:06.739621 23232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:06.740607 23232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:06.750056 23239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.750062 23237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.750074 23241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:06.750435 23232 server_base.cc:1034] running on GCE node
I20260809 01:58:06.750792 23232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:06.751397 23232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:06.752560 23232 hybrid_clock.cc:648] HybridClock initialized: now 1786240686752542 us; error 30 us; skew 500 ppm
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:06.755432 23232 init.cc:377] Logged in from keytab as oryx/127.14.175.193@KRBTEST.COM (short username oryx)
I20260809 01:58:06.756367 23232 webserver.cc:460] Webserver started at http://127.14.175.193:40025/ using document root <none> and password file <none>
I20260809 01:58:06.756868 23232 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:06.756927 23232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:06.757118 23232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:06.759126 23232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "7d61f3073f3a40de9b0b444c37bc29bc"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "a93c7480124f54cf30b43910a3458ca2"
server_key_iv: "57b50fcca8cdc4f1298a853b36596034"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.759681 23232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "7d61f3073f3a40de9b0b444c37bc29bc"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "a93c7480124f54cf30b43910a3458ca2"
server_key_iv: "57b50fcca8cdc4f1298a853b36596034"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.763056 23232 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 01:58:06.765228 23248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:06.766347 23232 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:06.766484 23232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "7d61f3073f3a40de9b0b444c37bc29bc"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "a93c7480124f54cf30b43910a3458ca2"
server_key_iv: "57b50fcca8cdc4f1298a853b36596034"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.766587 23232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:06.793459 23232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:06.796350 23232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:06.796551 23232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:06.797919 23232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:06.797991 23232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:06.798058 23232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:06.798107 23232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:06.809437 23232 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:45573
I20260809 01:58:06.809478 23373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:45573 every 8 connection(s)
I20260809 01:58:06.810262 23232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:06.811794 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:06.798765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:44595 (local address 127.14.175.254:33067)
0809 01:58:06.798880 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:06.798884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:06.799914 (+ 1030us) server_negotiation.cc:407] Connection header received
0809 01:58:06.800891 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:06.800898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:06.800967 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:06.801068 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:06.802272 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.803194 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.804711 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.804957 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.805082 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:06.808061 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:06.808065 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:06.808068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:06.808102 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:06.809679 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.810204 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.810208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.810210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.810321 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.810693 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.810698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.810699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.810927 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:06.811043 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:06.811490 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 01:58:06.811627 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 01:58:06.812494 23257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:06.799310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.193:44595)
0809 01:58:06.799768 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:06.799809 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:06.800642 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:06.801362 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:06.801369 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:06.801690 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:06.802121 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:06.802133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.803332 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.803338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:06.804570 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:06.804580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.805132 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.805136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:06.805331 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:06.805912 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:06.805939 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:06.807872 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:06.809795 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:06.809801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:06.809813 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:06.810070 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:06.810405 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:06.810411 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:06.810417 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:06.810592 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:06.811041 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:06.811048 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:06.811260 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 01:58:06.811450 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 01:58:06.811739 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":126,"threads_started":1}
I20260809 01:58:06.813724 23374 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33067
I20260809 01:58:06.813958 23374 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:06.814429 23374 heartbeater.cc:511] Master 127.14.175.254:33067 requested a full tablet report, sending...
I20260809 01:58:06.816121 23153 ts_manager.cc:194] Registered new tserver with Master: 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573)
I20260809 01:58:06.816411 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23232
I20260809 01:58:06.816555 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:06.816921 15039 external_mini_cluster.cc:1428] Setting key 83165eaa38657ee51a9e133a896fa688
I20260809 01:58:06.817664 23153 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:44595
I20260809 01:58:06.824560 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:06.816343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35593 (local address 127.14.175.254:33067)
0809 01:58:06.816610 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:06.816616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:06.816883 (+ 267us) server_negotiation.cc:407] Connection header received
0809 01:58:06.817085 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:06.817088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:06.817134 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:06.817218 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:06.817757 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.818478 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.819653 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.820043 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.820176 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:06.821464 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:06.821466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:06.821468 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:06.821489 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:06.822933 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.823381 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.823386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.823388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.823468 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:06.823742 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:06.823746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:06.823748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:06.823923 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:06.824031 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:06.824288 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 01:58:06.824399 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":179}
I20260809 01:58:06.824569 23380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:06.816243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.193:35593)
0809 01:58:06.816782 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:06.816820 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:06.816948 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:06.817259 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:06.817262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:06.817493 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:06.817634 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:06.817642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.818652 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.818656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:06.819520 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:06.819530 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:06.820174 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:06.820176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:06.820248 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:06.820789 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:06.820808 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:06.821323 (+ 515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:06.823065 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:06.823071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:06.823073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:06.823268 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:06.823560 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:06.823564 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:06.823566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:06.823651 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:06.824021 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:06.824024 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:06.824119 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 01:58:06.824224 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 01:58:06.824370 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for oryx/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
I20260809 01:58:06.847071 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33067
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:06.955724 23384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:06.955960 23384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:06.956010 23384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:06.960107 23384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:06.960162 23384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:06.960201 23384 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:58:06.960232 23384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:06.965240 23384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:33067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:06.966187 23384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:06.967214 23384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:06.976835 23389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.976817 23390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:06.976807 23392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:06.977105 23384 server_base.cc:1034] running on GCE node
I20260809 01:58:06.977610 23384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:06.978281 23384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:06.979436 23384 hybrid_clock.cc:648] HybridClock initialized: now 1786240686979425 us; error 25 us; skew 500 ppm
Aug 09 01:58:06 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:06.982230 23384 init.cc:377] Logged in from keytab as oryx/127.14.175.194@KRBTEST.COM (short username oryx)
I20260809 01:58:06.983153 23384 webserver.cc:460] Webserver started at http://127.14.175.194:36723/ using document root <none> and password file <none>
I20260809 01:58:06.983738 23384 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:06.983832 23384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:06.984066 23384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:06.986020 23384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "f6e5fe407ab049da8b779de046ad17d0"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "c0a4142064b2c7617b94d634ec223fde"
server_key_iv: "8a3ce2efc081a265f7901681b943c922"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.986583 23384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "f6e5fe407ab049da8b779de046ad17d0"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "c0a4142064b2c7617b94d634ec223fde"
server_key_iv: "8a3ce2efc081a265f7901681b943c922"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.990099 23384 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:58:06.992451 23399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:06.993588 23384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:06.993728 23384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "f6e5fe407ab049da8b779de046ad17d0"
format_stamp: "Formatted at 2026-08-09 01:58:06 on dist-test-slave-2w3w"
server_key: "c0a4142064b2c7617b94d634ec223fde"
server_key_iv: "8a3ce2efc081a265f7901681b943c922"
server_key_version: "encryptionkey@0"
I20260809 01:58:06.993832 23384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:07.003226 23384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:07.006062 23384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:07.006261 23384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:07.007720 23384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:07.007793 23384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:07.007861 23384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:07.007903 23384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:07.019208 23384 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:39937
I20260809 01:58:07.019282 23525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:39937 every 8 connection(s)
I20260809 01:58:07.020328 23384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:07.021788 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.008458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:43061 (local address 127.14.175.254:33067)
0809 01:58:07.008585 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.008596 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.009582 (+ 986us) server_negotiation.cc:407] Connection header received
0809 01:58:07.010466 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.010470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.010530 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.010635 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.012126 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.013043 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.014543 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.014784 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.014899 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.017849 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.017855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.017858 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.017886 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.019743 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.020211 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.020215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.020216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.020315 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.020743 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.020747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.020749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.020977 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.021082 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.021566 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.021669 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:58:07.022538 23408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.008937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.194:43061)
0809 01:58:07.009440 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.009480 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.010261 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.010926 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.010932 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.011446 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:07.011969 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.011983 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.013172 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.013176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.014414 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.014428 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.014948 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.014952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.015189 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.015776 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:07.015802 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:07.017673 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:07.019852 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.019856 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.019866 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.020103 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.020499 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.020501 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.020503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.020641 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.021076 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:07.021082 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:07.021350 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.021513 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.021750 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":143,"threads_started":1}
I20260809 01:58:07.023386 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23384
I20260809 01:58:07.023531 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:07.023875 15039 external_mini_cluster.cc:1428] Setting key ea8e3e0a4e98ed4b51befc1ec60815f4
I20260809 01:58:07.023901 23528 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33067
I20260809 01:58:07.024050 23528 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:07.024641 23528 heartbeater.cc:511] Master 127.14.175.254:33067 requested a full tablet report, sending...
I20260809 01:58:07.025647 23150 ts_manager.cc:194] Registered new tserver with Master: f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937)
I20260809 01:58:07.026500 23150 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:43061
WARNING: no policy specified for oryx/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:58:07.033789 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.026074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53329 (local address 127.14.175.254:33067)
0809 01:58:07.026833 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.026839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.026856 (+ 17us) server_negotiation.cc:407] Connection header received
0809 01:58:07.026893 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.026899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.026946 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.027050 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.027729 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.028425 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.029239 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.029481 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.029584 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.030657 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.030660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.030663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.030686 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.032149 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.032573 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.032576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.032578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.032653 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.032934 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.032939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.032941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.033143 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.033250 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.033545 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.033649 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668}
I20260809 01:58:07.033813 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.026009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.194:53329)
0809 01:58:07.026278 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.026292 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.026372 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.027178 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.027183 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.027428 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:07.027615 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.027622 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.028547 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.028550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.029120 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.029128 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.029590 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.029594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.029691 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.030192 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:07.030204 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:07.030508 (+ 304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:07.032260 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.032266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.032269 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.032465 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.032743 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.032747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.032749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.032843 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.033241 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:07.033244 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:07.033369 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.033476 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.033615 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":3,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
I20260809 01:58:07.052472 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33067
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:07.164075 23537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:07.164319 23537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:07.164362 23537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:07.168274 23537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:07.168325 23537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:07.168362 23537 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 01:58:07.168394 23537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:07.173506 23537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.175.254:33067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:07.174405 23537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:07.175360 23537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:07.184690 23545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:07.184676 23543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:07.184651 23542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:07.184939 23537 server_base.cc:1034] running on GCE node
I20260809 01:58:07.185351 23537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:07.186002 23537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:07.187184 23537 hybrid_clock.cc:648] HybridClock initialized: now 1786240687187177 us; error 30 us; skew 500 ppm
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:07.189862 23537 init.cc:377] Logged in from keytab as oryx/127.14.175.195@KRBTEST.COM (short username oryx)
I20260809 01:58:07.190740 23537 webserver.cc:460] Webserver started at http://127.14.175.195:41169/ using document root <none> and password file <none>
I20260809 01:58:07.191350 23537 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:07.191455 23537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:07.191689 23537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:07.193709 23537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "1048c9c2f94643fe9984a47116669862"
format_stamp: "Formatted at 2026-08-09 01:58:07 on dist-test-slave-2w3w"
server_key: "2552a4281bdf218648130b13d4a4c378"
server_key_iv: "d4ffd53317ddeef6e3110d7d4c7eed0c"
server_key_version: "encryptionkey@0"
I20260809 01:58:07.194270 23537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "1048c9c2f94643fe9984a47116669862"
format_stamp: "Formatted at 2026-08-09 01:58:07 on dist-test-slave-2w3w"
server_key: "2552a4281bdf218648130b13d4a4c378"
server_key_iv: "d4ffd53317ddeef6e3110d7d4c7eed0c"
server_key_version: "encryptionkey@0"
I20260809 01:58:07.198043 23537 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:58:07.200554 23552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:07.201704 23537 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:07.201834 23537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1048c9c2f94643fe9984a47116669862"
format_stamp: "Formatted at 2026-08-09 01:58:07 on dist-test-slave-2w3w"
server_key: "2552a4281bdf218648130b13d4a4c378"
server_key_iv: "d4ffd53317ddeef6e3110d7d4c7eed0c"
server_key_version: "encryptionkey@0"
I20260809 01:58:07.201939 23537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:07.220125 23537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:07.222838 23537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:07.223080 23537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:07.224568 23537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:07.224659 23537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:07.224732 23537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:07.224778 23537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:07.235662 23537 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:43907
I20260809 01:58:07.235929 23679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:43907 every 8 connection(s)
I20260809 01:58:07.236574 23537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:07.238233 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.225329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:43339 (local address 127.14.175.254:33067)
0809 01:58:07.225463 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.225466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.226448 (+ 982us) server_negotiation.cc:407] Connection header received
0809 01:58:07.227473 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.227476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.227536 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.227623 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.229210 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.229827 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.231006 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.231340 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.231461 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.234594 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.234597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.234600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.234628 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.236293 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.236804 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.236814 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.236816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.236902 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.237284 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.237290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.237293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.237494 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.237573 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.238018 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.238115 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 01:58:07.239032 23562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.225827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.195:43339)
0809 01:58:07.226298 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.226350 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.227265 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.227837 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.227848 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.228354 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:07.229044 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.229068 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.229959 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.229963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.230830 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.230839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.231509 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.231513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.231686 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.232310 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:07.232329 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:07.234423 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:07.236410 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.236416 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.236429 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.236707 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.237005 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.237008 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.237010 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.237145 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.237597 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:07.237602 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:07.237805 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.237959 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.238197 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":142,"threads_started":1}
I20260809 01:58:07.239099 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23537
I20260809 01:58:07.239243 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:07.239563 15039 external_mini_cluster.cc:1428] Setting key 0f788e0231f50bac62392139fe8ee952
I20260809 01:58:07.240527 23680 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33067
I20260809 01:58:07.240669 23680 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:07.241210 23680 heartbeater.cc:511] Master 127.14.175.254:33067 requested a full tablet report, sending...
I20260809 01:58:07.242269 23150 ts_manager.cc:194] Registered new tserver with Master: 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.242990 23150 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:43339
I20260809 01:58:07.243083 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:58:07.249792 23686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.242563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.14.175.195:57981)
0809 01:58:07.242870 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.242885 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.242991 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.243297 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.243300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.243520 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:07.243623 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.243629 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.244380 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.244383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.244955 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.244962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.245410 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.245414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.245503 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.246020 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:07.246033 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:07.246365 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:07.248279 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.248282 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.248284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.248524 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.248807 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.248810 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.248812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.248894 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.249248 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:07.249251 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:07.249348 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.249452 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.249588 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260809 01:58:07.249778 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.242606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:57981 (local address 127.14.175.254:33067)
0809 01:58:07.242713 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.242717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.242934 (+ 217us) server_negotiation.cc:407] Connection header received
0809 01:58:07.243076 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.243079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.243115 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.243193 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.243754 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.244248 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.245080 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.245299 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.245406 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.246499 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.246502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.246505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.246527 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.248174 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.248628 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.248631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.248633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.248713 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.248985 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.248988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.248990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.249153 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.249253 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.249506 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.249605 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 01:58:07.268155 23206 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:07.262116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41892 (local address 127.14.175.254:33067)
0809 01:58:07.262248 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.262251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.262262 (+ 11us) server_negotiation.cc:407] Connection header received
0809 01:58:07.262293 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.262295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.262326 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.262429 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.263194 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.263698 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.264551 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.264766 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.264876 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.268056 (+ 3180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41892: BlockingRecv error: recv got EOF from 127.0.0.1:41892 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:07.277181 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.269611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41896 (local address 127.14.175.254:33067)
0809 01:58:07.269744 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.269748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.269909 (+ 161us) server_negotiation.cc:407] Connection header received
0809 01:58:07.270030 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.270032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.270065 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.270129 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.270687 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.271255 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.272022 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.272251 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.272324 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.274427 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.274431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.274434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.274455 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.275888 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.276292 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.276294 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.276295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.276362 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.276593 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.276595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.276596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.276738 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.276834 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.277001 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.277080 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 01:58:07.279871 23150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:07.282850 23150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:07.296866 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.290588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:45573 (local address 127.0.0.1:47822)
0809 01:58:07.290943 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.291037 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.291146 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.292277 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.292285 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.292314 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.292448 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.292457 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.293704 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.293709 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.295213 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.295225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296261 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.296265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.296399 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.296448 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.296560 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.296678 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":54,"thread_start_us":103,"threads_started":1}
I20260809 01:58:07.296931 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.290751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.14.175.193:45573)
0809 01:58:07.291745 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.291759 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.291788 (+ 29us) server_negotiation.cc:407] Connection header received
0809 01:58:07.291878 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.291883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.292095 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.292602 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.292754 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.293587 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.295323 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296126 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.296272 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.296401 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.296615 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.296764 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":84,"threads_started":1}
I20260809 01:58:07.297576 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.291429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.14.175.195:43907)
0809 01:58:07.291766 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.291785 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.291835 (+ 50us) server_negotiation.cc:407] Connection header received
0809 01:58:07.291914 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.291918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.292312 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.292719 (+ 407us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.292856 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.294045 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.295735 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296506 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.297231 (+ 725us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.297360 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.297410 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.297474 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":159,"threads_started":1}
I20260809 01:58:07.299288 23709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.291960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.14.175.194:39937)
0809 01:58:07.292296 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.292318 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.292340 (+ 22us) server_negotiation.cc:407] Connection header received
0809 01:58:07.292415 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.292422 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.292581 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.292719 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.292977 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.294088 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.295711 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296298 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.296432 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.296566 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.299102 (+ 2536us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.299181 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":123,"threads_started":1}
I20260809 01:58:07.299561 23706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.290842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43907 (local address 127.0.0.1:51642)
0809 01:58:07.291400 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.291411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.291511 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.292466 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.292469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.292486 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.292573 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.292579 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.294187 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.294193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.295600 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.295611 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296667 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.296670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.296773 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.296797 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.296896 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.297120 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":144,"thread_start_us":84,"threads_started":1}
I20260809 01:58:07.299769 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.291312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:39937 (local address 127.0.0.1:49156)
0809 01:58:07.291565 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.291579 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.291650 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.292724 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.292727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.292744 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.292849 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.292855 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.294216 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.294220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.295593 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.295601 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.296628 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.296631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.296723 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.296745 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.296812 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.296875 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":181,"thread_start_us":95,"threads_started":1}
I20260809 01:58:07.299746 23302 tablet_service.cc:1467] Processing CreateTablet for tablet 027eaf1150de49068da95f8093aeb62f (DEFAULT_TABLE table=test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.300882 23302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 027eaf1150de49068da95f8093aeb62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.301875 23452 tablet_service.cc:1467] Processing CreateTablet for tablet 027eaf1150de49068da95f8093aeb62f (DEFAULT_TABLE table=test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.302147 23609 tablet_service.cc:1467] Processing CreateTablet for tablet 027eaf1150de49068da95f8093aeb62f (DEFAULT_TABLE table=test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.302681 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 027eaf1150de49068da95f8093aeb62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.303088 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 027eaf1150de49068da95f8093aeb62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.309003 23710 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Bootstrap starting.
I20260809 01:58:07.309422 23711 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Bootstrap starting.
I20260809 01:58:07.310266 23712 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Bootstrap starting.
I20260809 01:58:07.312146 23711 tablet_bootstrap.cc:654] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.312397 23712 tablet_bootstrap.cc:654] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.312397 23710 tablet_bootstrap.cc:654] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.312980 23711 log.cc:824] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:07.313196 23712 log.cc:824] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:07.313596 23710 log.cc:824] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:07.315256 23712 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: No bootstrap required, opened a new log
I20260809 01:58:07.315258 23711 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: No bootstrap required, opened a new log
I20260809 01:58:07.315454 23712 ts_tablet_manager.cc:1397] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260809 01:58:07.315456 23711 ts_tablet_manager.cc:1397] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:58:07.315503 23710 tablet_bootstrap.cc:492] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: No bootstrap required, opened a new log
I20260809 01:58:07.315641 23710 ts_tablet_manager.cc:1397] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 01:58:07.318722 23712 raft_consensus.cc:348] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.318955 23712 raft_consensus.cc:374] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.319031 23712 raft_consensus.cc:729] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.319442 23712 consensus_queue.cc:260] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.319367 23710 raft_consensus.cc:348] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.319367 23711 raft_consensus.cc:348] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.319592 23710 raft_consensus.cc:374] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.319592 23711 raft_consensus.cc:374] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.319649 23711 raft_consensus.cc:729] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.319657 23710 raft_consensus.cc:729] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e5fe407ab049da8b779de046ad17d0, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.320039 23680 heartbeater.cc:503] Master 127.14.175.254:33067 was elected leader, sending a full tablet report...
I20260809 01:58:07.320039 23710 consensus_queue.cc:260] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.320412 23712 ts_tablet_manager.cc:1428] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 01:58:07.320959 23711 consensus_queue.cc:260] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.321041 23710 ts_tablet_manager.cc:1428] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 01:58:07.321388 23528 heartbeater.cc:503] Master 127.14.175.254:33067 was elected leader, sending a full tablet report...
I20260809 01:58:07.321705 23374 heartbeater.cc:503] Master 127.14.175.254:33067 was elected leader, sending a full tablet report...
I20260809 01:58:07.321861 23711 ts_tablet_manager.cc:1428] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 01:58:07.414499 23719 raft_consensus.cc:482] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:07.414739 23719 raft_consensus.cc:504] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.415966 23719 leader_election.cc:288] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.422019 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.416343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:40739 (local address 127.14.175.195:43907)
0809 01:58:07.416496 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.416501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.416833 (+ 332us) server_negotiation.cc:407] Connection header received
0809 01:58:07.417051 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.417055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.417114 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.417170 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.417779 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.418697 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.420675 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.421336 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.421459 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.421510 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.421809 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.421905 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 01:58:07.422125 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.416341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:43907 (local address 127.14.175.193:40739)
0809 01:58:07.416735 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.416748 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.416915 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.417364 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.417369 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.417386 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.417646 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.417654 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.418836 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.418840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.420514 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.420526 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.421515 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.421523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.421656 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.421695 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.421791 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.421902 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":61,"thread_start_us":93,"threads_started":1}
I20260809 01:58:07.422821 23709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.416972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:37697 (local address 127.14.175.194:39937)
0809 01:58:07.417151 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.417156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.417171 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:07.417226 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.417229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.417281 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.417360 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.418230 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.419082 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.420737 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.421335 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.421459 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.421510 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.422568 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.422672 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 01:58:07.422828 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "027eaf1150de49068da95f8093aeb62f" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862" is_pre_election: true
I20260809 01:58:07.423185 23630 raft_consensus.cc:2454] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.423251 23720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.416159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:39937 (local address 127.14.175.193:37697)
0809 01:58:07.416734 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.416753 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.416868 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.417481 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.417484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.417500 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.417659 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.417664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.419203 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.419210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.420611 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.420624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.422273 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.422278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.422394 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.422427 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.422986 (+ 559us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.423074 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":36,"thread_start_us":104,"threads_started":1}
I20260809 01:58:07.423720 23251 leader_election.cc:302] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, 7d61f3073f3a40de9b0b444c37bc29bc; no voters:
I20260809 01:58:07.423842 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "027eaf1150de49068da95f8093aeb62f" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0" is_pre_election: true
I20260809 01:58:07.424144 23474 raft_consensus.cc:2454] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.427057 23719 raft_consensus.cc:2781] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:07.427150 23719 raft_consensus.cc:482] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:07.427188 23719 raft_consensus.cc:3037] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.428481 23719 raft_consensus.cc:504] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.428815 23719 leader_election.cc:288] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Requested vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.431321 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "027eaf1150de49068da95f8093aeb62f" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862"
I20260809 01:58:07.431437 23630 raft_consensus.cc:3037] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.432339 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "027eaf1150de49068da95f8093aeb62f" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0"
I20260809 01:58:07.432495 23474 raft_consensus.cc:3037] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.432833 23630 raft_consensus.cc:2454] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.433173 23251 leader_election.cc:302] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, 7d61f3073f3a40de9b0b444c37bc29bc; no voters:
I20260809 01:58:07.433344 23719 raft_consensus.cc:2781] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:07.433588 23719 raft_consensus.cc:686] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Becoming Leader. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Running, Role: LEADER
I20260809 01:58:07.433964 23474 raft_consensus.cc:2454] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.434325 23719 consensus_queue.cc:237] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.438151 23153 catalog_manager.cc:5495] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193). New cstate: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:07.486339 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.482736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47832 (local address 127.14.175.193:45573)
0809 01:58:07.482891 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.482896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.482912 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:58:07.483069 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.483072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.483129 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.483239 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:07.483495 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.484005 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.484867 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.485101 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.485214 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.485495 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:07.485908 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:07.486035 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.486098 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.486167 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 01:58:07.487999 23681 tablet.cc:2369] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:07.492441 23474 raft_consensus.cc:1261] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.492475 23630 raft_consensus.cc:1261] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.493147 23722 consensus_queue.cc:1035] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.493408 23719 consensus_queue.cc:1035] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.501909 23726 mvcc.cc:205] Tried to move back new op lower bound from 7316441855961657344 to 7316441855734202368. Current Snapshot: MvccSnapshot[applied={T|T < 7316441855961657344}]
I20260809 01:58:07.513257 23152 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:07.513470 23152 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:07.515795 23152 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Sending DeleteTablet for 3 replicas of tablet 027eaf1150de49068da95f8093aeb62f
I20260809 01:58:07.516682 23452 tablet_service.cc:1514] Processing DeleteTablet for tablet 027eaf1150de49068da95f8093aeb62f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49156
I20260809 01:58:07.516700 23302 tablet_service.cc:1514] Processing DeleteTablet for tablet 027eaf1150de49068da95f8093aeb62f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47822
I20260809 01:58:07.516685 23609 tablet_service.cc:1514] Processing DeleteTablet for tablet 027eaf1150de49068da95f8093aeb62f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:51642
I20260809 01:58:07.517225 23738 tablet_replica.cc:330] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: stopping tablet replica
I20260809 01:58:07.517526 23736 tablet_replica.cc:330] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: stopping tablet replica
I20260809 01:58:07.517524 23738 raft_consensus.cc:2229] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:07.517802 23738 raft_consensus.cc:2258] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.518066 23736 raft_consensus.cc:2229] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:07.518015 23152 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:07.518425 23152 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:07.518777 23736 raft_consensus.cc:2258] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.520231 23738 ts_tablet_manager.cc:1905] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.520824 23736 ts_tablet_manager.cc:1905] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.523388 23738 ts_tablet_manager.cc:1918] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:07.523496 23738 log.cc:1196] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/027eaf1150de49068da95f8093aeb62f
I20260809 01:58:07.523823 23738 ts_tablet_manager.cc:1939] T 027eaf1150de49068da95f8093aeb62f P 1048c9c2f94643fe9984a47116669862: Deleting consensus metadata
I20260809 01:58:07.524001 23302 tablet_service.cc:1467] Processing CreateTablet for tablet afe0785e62b8466ba87408f45026b157 (DEFAULT_TABLE table=test-table [id=f15286810db2477588b0199c7f6a5ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.524251 23302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe0785e62b8466ba87408f45026b157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.525409 23736 ts_tablet_manager.cc:1918] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:07.525637 23737 tablet_replica.cc:330] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: stopping tablet replica
I20260809 01:58:07.526003 23737 raft_consensus.cc:2229] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:07.526168 23736 log.cc:1196] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/027eaf1150de49068da95f8093aeb62f
I20260809 01:58:07.526475 23711 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Bootstrap starting.
I20260809 01:58:07.527155 23138 catalog_manager.cc:4841] TS 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907): tablet 027eaf1150de49068da95f8093aeb62f (table test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]) successfully deleted
I20260809 01:58:07.527491 23711 tablet_bootstrap.cc:654] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.527685 23609 tablet_service.cc:1467] Processing CreateTablet for tablet afe0785e62b8466ba87408f45026b157 (DEFAULT_TABLE table=test-table [id=f15286810db2477588b0199c7f6a5ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.527930 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe0785e62b8466ba87408f45026b157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.526904 23452 tablet_service.cc:1467] Processing CreateTablet for tablet afe0785e62b8466ba87408f45026b157 (DEFAULT_TABLE table=test-table [id=f15286810db2477588b0199c7f6a5ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.528349 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe0785e62b8466ba87408f45026b157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.530346 23712 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Bootstrap starting.
I20260809 01:58:07.530500 23710 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Bootstrap starting.
I20260809 01:58:07.531250 23711 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: No bootstrap required, opened a new log
I20260809 01:58:07.531278 23712 tablet_bootstrap.cc:654] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.531333 23711 ts_tablet_manager.cc:1397] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:58:07.531505 23710 tablet_bootstrap.cc:654] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.531848 23711 raft_consensus.cc:348] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.531971 23711 raft_consensus.cc:374] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.532013 23711 raft_consensus.cc:729] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.532136 23711 consensus_queue.cc:260] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.532410 23711 ts_tablet_manager.cc:1428] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:58:07.533298 23737 raft_consensus.cc:2258] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.533656 23736 ts_tablet_manager.cc:1939] T 027eaf1150de49068da95f8093aeb62f P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting consensus metadata
I20260809 01:58:07.535216 23137 catalog_manager.cc:4841] TS 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573): tablet 027eaf1150de49068da95f8093aeb62f (table test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]) successfully deleted
I20260809 01:58:07.535259 23712 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: No bootstrap required, opened a new log
I20260809 01:58:07.535336 23712 ts_tablet_manager.cc:1397] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:58:07.535579 23710 tablet_bootstrap.cc:492] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: No bootstrap required, opened a new log
I20260809 01:58:07.535687 23710 ts_tablet_manager.cc:1397] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:58:07.535727 23712 raft_consensus.cc:348] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.535840 23712 raft_consensus.cc:374] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.535879 23712 raft_consensus.cc:729] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.535995 23712 consensus_queue.cc:260] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.536181 23710 raft_consensus.cc:348] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.536278 23712 ts_tablet_manager.cc:1428] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:58:07.536298 23710 raft_consensus.cc:374] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.536345 23710 raft_consensus.cc:729] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e5fe407ab049da8b779de046ad17d0, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.536461 23710 consensus_queue.cc:260] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.536720 23710 ts_tablet_manager.cc:1428] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:07.540333 23737 ts_tablet_manager.cc:1905] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.542712 23737 ts_tablet_manager.cc:1918] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:07.542826 23737 log.cc:1196] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/027eaf1150de49068da95f8093aeb62f
I20260809 01:58:07.543197 23737 ts_tablet_manager.cc:1939] T 027eaf1150de49068da95f8093aeb62f P f6e5fe407ab049da8b779de046ad17d0: Deleting consensus metadata
I20260809 01:58:07.544281 23137 catalog_manager.cc:4841] TS f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937): tablet 027eaf1150de49068da95f8093aeb62f (table test-table [id=c440752c6ef44ba3921d03a6e5ec5c0d]) successfully deleted
W20260809 01:58:07.561990 23375 tablet.cc:2369] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:07.611685 23733 raft_consensus.cc:482] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:07.611810 23733 raft_consensus.cc:504] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.612254 23733 leader_election.cc:288] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.612663 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe0785e62b8466ba87408f45026b157" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862" is_pre_election: true
I20260809 01:58:07.612663 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe0785e62b8466ba87408f45026b157" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0" is_pre_election: true
I20260809 01:58:07.612816 23630 raft_consensus.cc:2454] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.612816 23474 raft_consensus.cc:2454] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.613106 23251 leader_election.cc:302] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, 7d61f3073f3a40de9b0b444c37bc29bc; no voters:
I20260809 01:58:07.613289 23733 raft_consensus.cc:2781] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:07.613353 23733 raft_consensus.cc:482] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:07.613421 23733 raft_consensus.cc:3037] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.614392 23733 raft_consensus.cc:504] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.614799 23733 leader_election.cc:288] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Requested vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.615109 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe0785e62b8466ba87408f45026b157" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0"
I20260809 01:58:07.615136 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe0785e62b8466ba87408f45026b157" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862"
I20260809 01:58:07.615247 23630 raft_consensus.cc:3037] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.615247 23474 raft_consensus.cc:3037] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.616358 23474 raft_consensus.cc:2454] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.616358 23630 raft_consensus.cc:2454] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.616650 23250 leader_election.cc:302] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d61f3073f3a40de9b0b444c37bc29bc, f6e5fe407ab049da8b779de046ad17d0; no voters:
I20260809 01:58:07.616832 23733 raft_consensus.cc:2781] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:07.616948 23733 raft_consensus.cc:686] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Becoming Leader. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Running, Role: LEADER
I20260809 01:58:07.617090 23733 consensus_queue.cc:237] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.618750 23150 catalog_manager.cc:5495] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193). New cstate: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } health_report { overall_health: UNKNOWN } } }
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240686, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.254@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:07.658070 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.648718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41910 (local address 127.14.175.254:33067)
0809 01:58:07.648854 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.648858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.648925 (+ 67us) server_negotiation.cc:407] Connection header received
0809 01:58:07.649038 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.649042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.649091 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.649188 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.649830 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.650661 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.651587 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.651924 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.652055 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.654545 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.654548 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.654550 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.654572 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.656153 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.656727 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.656729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.656730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.656800 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.657147 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.657149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.657150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.657310 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.657397 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.657760 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.657942 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":62}
I20260809 01:58:07.658079 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.648544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33067 (local address 127.0.0.1:41910)
0809 01:58:07.648825 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.648848 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.648943 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.649226 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.649228 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.649605 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:07.649698 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.649704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.650776 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.650779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.651459 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.651468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.652054 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.652056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.652156 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.652779 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:07.652790 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:07.654399 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:07.656260 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.656270 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.656276 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.656631 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.656932 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:07.656936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:07.656938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:07.657043 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:07.657438 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:07.657444 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:07.657582 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.657714 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.657873 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260809 01:58:07.662111 23150 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:41910:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 01:58:07.662899 23150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:07.667770 23302 tablet_service.cc:1467] Processing CreateTablet for tablet 94339b15080847a788cda948118b6262 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=185fb80729f1429299bbfe0ad8c7c91d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:58:07.668169 23302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94339b15080847a788cda948118b6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.668120 23609 tablet_service.cc:1467] Processing CreateTablet for tablet 94339b15080847a788cda948118b6262 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=185fb80729f1429299bbfe0ad8c7c91d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:58:07.668514 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94339b15080847a788cda948118b6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.671092 23711 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: Bootstrap starting.
I20260809 01:58:07.671239 23712 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: Bootstrap starting.
I20260809 01:58:07.671469 23452 tablet_service.cc:1467] Processing CreateTablet for tablet 94339b15080847a788cda948118b6262 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=185fb80729f1429299bbfe0ad8c7c91d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 01:58:07.671810 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94339b15080847a788cda948118b6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.672274 23712 tablet_bootstrap.cc:654] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.672487 23711 tablet_bootstrap.cc:654] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.673862 23712 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: No bootstrap required, opened a new log
I20260809 01:58:07.673947 23712 ts_tablet_manager.cc:1397] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:07.674031 23711 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: No bootstrap required, opened a new log
I20260809 01:58:07.674111 23711 ts_tablet_manager.cc:1397] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 01:58:07.674423 23712 raft_consensus.cc:348] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.674532 23712 raft_consensus.cc:374] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.674576 23712 raft_consensus.cc:729] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.674535 23711 raft_consensus.cc:348] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.674654 23711 raft_consensus.cc:374] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.674690 23711 raft_consensus.cc:729] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.674722 23712 consensus_queue.cc:260] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.674814 23711 consensus_queue.cc:260] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.674906 23710 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: Bootstrap starting.
I20260809 01:58:07.675024 23712 ts_tablet_manager.cc:1428] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 01:58:07.675109 23711 ts_tablet_manager.cc:1428] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:07.675411 23717 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.675585 23717 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.675777 23733 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.675871 23733 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.675877 23710 tablet_bootstrap.cc:654] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.678177 23710 tablet_bootstrap.cc:492] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: No bootstrap required, opened a new log
I20260809 01:58:07.678270 23710 ts_tablet_manager.cc:1397] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:07.678699 23710 raft_consensus.cc:348] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.678813 23710 raft_consensus.cc:374] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.678845 23710 raft_consensus.cc:729] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e5fe407ab049da8b779de046ad17d0, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.678987 23710 consensus_queue.cc:260] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.679240 23710 ts_tablet_manager.cc:1428] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:07.679855 23718 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.679989 23718 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.708592 23733 raft_consensus.cc:482] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:07.708714 23733 raft_consensus.cc:504] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.709183 23733 leader_election.cc:288] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.709594 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94339b15080847a788cda948118b6262" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0" is_pre_election: true
I20260809 01:58:07.709628 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94339b15080847a788cda948118b6262" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862" is_pre_election: true
I20260809 01:58:07.709725 23474 raft_consensus.cc:2454] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.709816 23630 raft_consensus.cc:2454] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:07.710058 23250 leader_election.cc:302] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d61f3073f3a40de9b0b444c37bc29bc, f6e5fe407ab049da8b779de046ad17d0; no voters:
I20260809 01:58:07.710273 23733 raft_consensus.cc:2781] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:07.710366 23733 raft_consensus.cc:482] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:07.710428 23733 raft_consensus.cc:3037] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.711442 23733 raft_consensus.cc:504] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.711804 23733 leader_election.cc:288] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Requested vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:07.712123 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94339b15080847a788cda948118b6262" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0"
I20260809 01:58:07.712146 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94339b15080847a788cda948118b6262" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862"
I20260809 01:58:07.712262 23474 raft_consensus.cc:3037] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.712283 23630 raft_consensus.cc:3037] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:07.713160 23630 raft_consensus.cc:2454] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.713176 23474 raft_consensus.cc:2454] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:07.713474 23250 leader_election.cc:302] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d61f3073f3a40de9b0b444c37bc29bc, f6e5fe407ab049da8b779de046ad17d0; no voters:
I20260809 01:58:07.713668 23733 raft_consensus.cc:2781] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:07.713779 23733 raft_consensus.cc:686] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Becoming Leader. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Running, Role: LEADER
I20260809 01:58:07.713936 23733 consensus_queue.cc:237] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.714718 23719 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: TxnStatusTablet state changed. Reason: New leader 7d61f3073f3a40de9b0b444c37bc29bc. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.714883 23719 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:58:07.715277 23756 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 01:58:07.715441 23756 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 01:58:07.715788 23150 catalog_manager.cc:5495] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193). New cstate: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:07.735446 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.731796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47842 (local address 127.14.175.193:45573)
0809 01:58:07.731915 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.731919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.731995 (+ 76us) server_negotiation.cc:407] Connection header received
0809 01:58:07.732163 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.732167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.732228 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.732315 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:07.732613 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.733106 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.734359 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.734579 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.734654 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.735032 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:07.735104 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:07.735159 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.735297 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.735342 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 01:58:07.735505 23751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.731709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:45573 (local address 127.0.0.1:47842)
0809 01:58:07.731925 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.731940 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.732046 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.732367 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.732370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.732378 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:58:07.732506 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.732513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.733211 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.733215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.734219 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.734230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.734684 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.734688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.734794 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.734847 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:58:07.735191 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:58:07.735206 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.735277 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.735367 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260809 01:58:07.737869 23474 raft_consensus.cc:1261] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.737859 23630 raft_consensus.cc:1261] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.738305 23733 consensus_queue.cc:1035] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.738456 23719 consensus_queue.cc:1035] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.739818 23717 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: TxnStatusTablet state changed. Reason: New leader 7d61f3073f3a40de9b0b444c37bc29bc. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.739943 23717 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.739980 23718 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: TxnStatusTablet state changed. Reason: New leader 7d61f3073f3a40de9b0b444c37bc29bc. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.740109 23718 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.742170 23725 mvcc.cc:205] Tried to move back new op lower bound from 7316441856970379264 to 7316441856877711360. Current Snapshot: MvccSnapshot[applied={T|T < 7316441856970379264}]
I20260809 01:58:07.742287 23722 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.742409 23722 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:58:07.742727 23722 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.742837 23722 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 7d61f3073f3a40de9b0b444c37bc29bc: This TxnStatusTablet replica's current role is: LEADER
I20260809 01:58:07.743947 23718 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.744050 23718 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P f6e5fe407ab049da8b779de046ad17d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.744750 23717 tablet_replica.cc:439] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } } }
I20260809 01:58:07.744851 23717 tablet_replica.cc:442] T 94339b15080847a788cda948118b6262 P 1048c9c2f94643fe9984a47116669862: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 01:58:07.745076 23727 mvcc.cc:205] Tried to move back new op lower bound from 7316441856970379264 to 7316441856877711360. Current Snapshot: MvccSnapshot[applied={T|T < 7316441856970379264 or (T in {7316441856970379264})}]
I20260809 01:58:07.756987 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.753331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:40111 (local address 127.14.175.193:45573)
0809 01:58:07.753446 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.753449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.753654 (+ 205us) server_negotiation.cc:407] Connection header received
0809 01:58:07.753754 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.753756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.753794 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.753855 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:07.754109 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.754608 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.755891 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.756209 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.756289 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.756583 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:07.756644 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:07.756697 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.756813 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.756870 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":41}
I20260809 01:58:07.757042 23762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.753246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:45573 (local address 127.14.175.193:40111)
0809 01:58:07.753566 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.753580 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.753680 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.753891 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.753894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.753901 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 01:58:07.754004 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.754009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.754705 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.754708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.755776 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.755789 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.756318 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.756321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:07.756408 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.756457 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 01:58:07.756722 (+ 265us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 01:58:07.756728 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:58:07.756794 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 01:58:07.756902 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":18,"thread_start_us":98,"threads_started":1}
I20260809 01:58:07.763068 23474 raft_consensus.cc:1261] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.763108 23630 raft_consensus.cc:1261] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:07.763456 23722 consensus_queue.cc:1035] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.763651 23719 consensus_queue.cc:1035] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:07.800194 23150 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:07.800359 23150 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:07.802302 23150 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Sending DeleteTablet for 3 replicas of tablet afe0785e62b8466ba87408f45026b157
I20260809 01:58:07.802814 23301 tablet_service.cc:1514] Processing DeleteTablet for tablet afe0785e62b8466ba87408f45026b157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47822
I20260809 01:58:07.802897 23452 tablet_service.cc:1514] Processing DeleteTablet for tablet afe0785e62b8466ba87408f45026b157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49156
I20260809 01:58:07.802990 23736 tablet_replica.cc:330] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: stopping tablet replica
I20260809 01:58:07.803081 23737 tablet_replica.cc:330] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: stopping tablet replica
I20260809 01:58:07.803090 23736 raft_consensus.cc:2229] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:07.803095 23609 tablet_service.cc:1514] Processing DeleteTablet for tablet afe0785e62b8466ba87408f45026b157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:07 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:51642
I20260809 01:58:07.803192 23737 raft_consensus.cc:2229] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:07.803237 23738 tablet_replica.cc:330] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: stopping tablet replica
I20260809 01:58:07.803243 23736 raft_consensus.cc:2258] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.803294 23737 raft_consensus.cc:2258] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.803335 23738 raft_consensus.cc:2229] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:07.803444 23738 raft_consensus.cc:2258] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:07.803957 23736 ts_tablet_manager.cc:1905] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.804085 23737 ts_tablet_manager.cc:1905] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.804673 23738 ts_tablet_manager.cc:1905] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:07.806978 23736 ts_tablet_manager.cc:1918] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:58:07.806953 23737 ts_tablet_manager.cc:1918] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:58:07.807067 23736 log.cc:1196] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/afe0785e62b8466ba87408f45026b157
I20260809 01:58:07.807107 23737 log.cc:1196] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/afe0785e62b8466ba87408f45026b157
I20260809 01:58:07.807351 23736 ts_tablet_manager.cc:1939] T afe0785e62b8466ba87408f45026b157 P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting consensus metadata
I20260809 01:58:07.807399 23737 ts_tablet_manager.cc:1939] T afe0785e62b8466ba87408f45026b157 P f6e5fe407ab049da8b779de046ad17d0: Deleting consensus metadata
I20260809 01:58:07.807430 23738 ts_tablet_manager.cc:1918] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:58:07.807497 23738 log.cc:1196] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/afe0785e62b8466ba87408f45026b157
I20260809 01:58:07.807745 23738 ts_tablet_manager.cc:1939] T afe0785e62b8466ba87408f45026b157 P 1048c9c2f94643fe9984a47116669862: Deleting consensus metadata
I20260809 01:58:07.808110 23137 catalog_manager.cc:4841] TS 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573): tablet afe0785e62b8466ba87408f45026b157 (table test-table [id=f15286810db2477588b0199c7f6a5ca5]) successfully deleted
I20260809 01:58:07.808251 23137 catalog_manager.cc:4841] TS f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937): tablet afe0785e62b8466ba87408f45026b157 (table test-table [id=f15286810db2477588b0199c7f6a5ca5]) successfully deleted
I20260809 01:58:07.808635 23138 catalog_manager.cc:4841] TS 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907): tablet afe0785e62b8466ba87408f45026b157 (table test-table [id=f15286810db2477588b0199c7f6a5ca5]) successfully deleted
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 01:58:07.843712 23206 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:07.837139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.14.175.254:33067)
0809 01:58:07.837276 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.837281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.837450 (+ 169us) server_negotiation.cc:407] Connection header received
0809 01:58:07.837624 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.837628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.837685 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.837775 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.838500 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.839130 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.840110 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.840350 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.840464 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.843588 (+ 3124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41912: BlockingRecv error: recv got EOF from 127.0.0.1:41912 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 01:58:07 dist-test-slave-2w3w krb5kdc[23106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM
I20260809 01:58:07.853881 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.845241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41918 (local address 127.14.175.254:33067)
0809 01:58:07.845363 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.845367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.845622 (+ 255us) server_negotiation.cc:407] Connection header received
0809 01:58:07.845698 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.845701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.845750 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.845846 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:07.846402 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.847187 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.847939 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.848277 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.848423 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:07.850750 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:07.850754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:07.850756 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:07.850777 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:07.852208 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.852631 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.852635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.852637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.852718 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:07.853020 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:07.853023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:07.853025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:07.853199 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:07.853339 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:07.853594 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 01:58:07.853714 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 01:58:07.856562 23150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:07.857044 23150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:07.861874 23301 tablet_service.cc:1467] Processing CreateTablet for tablet 971feff1b51d47e7b618527cc66cf48e (DEFAULT_TABLE table=test-table [id=f157df2474a4431cbb33aeda86c731a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.861982 23452 tablet_service.cc:1467] Processing CreateTablet for tablet 971feff1b51d47e7b618527cc66cf48e (DEFAULT_TABLE table=test-table [id=f157df2474a4431cbb33aeda86c731a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.862129 23609 tablet_service.cc:1467] Processing CreateTablet for tablet 971feff1b51d47e7b618527cc66cf48e (DEFAULT_TABLE table=test-table [id=f157df2474a4431cbb33aeda86c731a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:07.862206 23301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971feff1b51d47e7b618527cc66cf48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.862284 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971feff1b51d47e7b618527cc66cf48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.862390 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 971feff1b51d47e7b618527cc66cf48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:07.864753 23712 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Bootstrap starting.
I20260809 01:58:07.864784 23710 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Bootstrap starting.
I20260809 01:58:07.865621 23712 tablet_bootstrap.cc:654] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.865698 23710 tablet_bootstrap.cc:654] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.866304 23711 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Bootstrap starting.
I20260809 01:58:07.866851 23712 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: No bootstrap required, opened a new log
I20260809 01:58:07.866959 23712 ts_tablet_manager.cc:1397] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:07.867251 23711 tablet_bootstrap.cc:654] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:07.867470 23712 raft_consensus.cc:348] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.867604 23712 raft_consensus.cc:374] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.867646 23712 raft_consensus.cc:729] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.867785 23712 consensus_queue.cc:260] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.868093 23712 ts_tablet_manager.cc:1428] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 01:58:07.868338 23711 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: No bootstrap required, opened a new log
I20260809 01:58:07.868418 23711 ts_tablet_manager.cc:1397] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:07.868817 23711 raft_consensus.cc:348] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.868945 23711 raft_consensus.cc:374] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.868978 23711 raft_consensus.cc:729] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.869109 23711 consensus_queue.cc:260] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.869437 23711 ts_tablet_manager.cc:1428] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:07.869917 23710 tablet_bootstrap.cc:492] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: No bootstrap required, opened a new log
I20260809 01:58:07.870024 23710 ts_tablet_manager.cc:1397] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 01:58:07.870460 23710 raft_consensus.cc:348] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.870568 23710 raft_consensus.cc:374] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:07.870596 23710 raft_consensus.cc:729] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e5fe407ab049da8b779de046ad17d0, State: Initialized, Role: FOLLOWER
I20260809 01:58:07.870709 23710 consensus_queue.cc:260] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.870945 23710 ts_tablet_manager.cc:1428] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 01:58:07.995818 23717 raft_consensus.cc:482] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:07.996017 23717 raft_consensus.cc:504] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:07.997028 23717 leader_election.cc:288] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573), f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937)
I20260809 01:58:08.001355 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.997438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:56909 (local address 127.14.175.193:45573)
0809 01:58:07.997627 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.997634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.997692 (+ 58us) server_negotiation.cc:407] Connection header received
0809 01:58:07.997853 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.997856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.997910 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.998022 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.998453 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.999070 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.000372 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.000802 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.000903 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.000943 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:08.001182 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 01:58:08.001253 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 01:58:08.001360 23781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.997341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:45573 (local address 127.14.175.195:56909)
0809 01:58:07.997600 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.997613 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.997750 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.998205 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.998208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.998230 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.998335 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.998342 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:07.999169 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:07.999172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:08.000250 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:08.000258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.000932 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.000936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:08.001023 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.001049 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:58:08.001129 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 01:58:08.001193 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":21,"thread_start_us":78,"threads_started":1}
I20260809 01:58:08.001927 23322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971feff1b51d47e7b618527cc66cf48e" candidate_uuid: "1048c9c2f94643fe9984a47116669862" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" is_pre_election: true
I20260809 01:58:08.002187 23322 raft_consensus.cc:2454] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1048c9c2f94643fe9984a47116669862 in term 0.
I20260809 01:58:08.002621 23554 leader_election.cc:302] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, 7d61f3073f3a40de9b0b444c37bc29bc; no voters:
I20260809 01:58:08.002777 23782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.997692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:39937 (local address 127.14.175.195:45287)
0809 01:58:07.998063 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:07.998073 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:07.998183 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:07.999145 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:07.999148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:07.999168 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:07.999698 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:07.999708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.000473 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.000475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:08.001382 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:08.001394 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.002303 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.002310 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:08.002436 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.002474 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 01:58:08.002553 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 01:58:08.002630 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":21,"thread_start_us":96,"threads_started":1}
I20260809 01:58:08.002851 23783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:07.997822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:45287 (local address 127.14.175.194:39937)
0809 01:58:07.998131 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:07.998135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:07.998150 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:07.998290 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:07.998293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:07.998338 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:07.998427 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:07.999828 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.000337 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.001521 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.002116 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.002248 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.002298 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:08.002589 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 01:58:08.002671 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":98,"threads_started":1}
I20260809 01:58:08.002874 23717 raft_consensus.cc:2781] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:08.002941 23717 raft_consensus.cc:482] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:08.003022 23717 raft_consensus.cc:3037] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.003229 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971feff1b51d47e7b618527cc66cf48e" candidate_uuid: "1048c9c2f94643fe9984a47116669862" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0" is_pre_election: true
I20260809 01:58:08.003347 23474 raft_consensus.cc:2454] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1048c9c2f94643fe9984a47116669862 in term 0.
I20260809 01:58:08.004249 23717 raft_consensus.cc:504] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.004577 23717 leader_election.cc:288] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [CANDIDATE]: Term 1 election: Requested vote from peers 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573), f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937)
I20260809 01:58:08.004983 23322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971feff1b51d47e7b618527cc66cf48e" candidate_uuid: "1048c9c2f94643fe9984a47116669862" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d61f3073f3a40de9b0b444c37bc29bc"
I20260809 01:58:08.005013 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "971feff1b51d47e7b618527cc66cf48e" candidate_uuid: "1048c9c2f94643fe9984a47116669862" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0"
I20260809 01:58:08.005096 23322 raft_consensus.cc:3037] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.005143 23474 raft_consensus.cc:3037] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.006191 23474 raft_consensus.cc:2454] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1048c9c2f94643fe9984a47116669862 in term 1.
I20260809 01:58:08.006278 23322 raft_consensus.cc:2454] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1048c9c2f94643fe9984a47116669862 in term 1.
I20260809 01:58:08.006520 23554 leader_election.cc:302] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, f6e5fe407ab049da8b779de046ad17d0; no voters:
I20260809 01:58:08.006690 23717 raft_consensus.cc:2781] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:08.006862 23717 raft_consensus.cc:686] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 1 LEADER]: Becoming Leader. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Running, Role: LEADER
I20260809 01:58:08.007151 23717 consensus_queue.cc:237] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.009289 23150 catalog_manager.cc:5495] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1048c9c2f94643fe9984a47116669862 (127.14.175.195). New cstate: current_term: 1 leader_uuid: "1048c9c2f94643fe9984a47116669862" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } health_report { overall_health: HEALTHY } } }
W20260809 01:58:08.022730 23529 tablet.cc:2369] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:58:08.026218 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:08.022400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51654 (local address 127.14.175.195:43907)
0809 01:58:08.022659 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:08.022668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:08.022680 (+ 12us) server_negotiation.cc:407] Connection header received
0809 01:58:08.022741 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:08.022743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:08.022790 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:08.023260 (+ 470us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:08.023357 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.023939 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.024809 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.025045 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.025157 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.025434 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:08.025821 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:08.025945 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:08.026005 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 01:58:08.026057 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
I20260809 01:58:08.028626 23474 raft_consensus.cc:1261] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Refusing update from remote peer 1048c9c2f94643fe9984a47116669862: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:08.029054 23322 raft_consensus.cc:1261] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Refusing update from remote peer 1048c9c2f94643fe9984a47116669862: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:08.029137 23784 consensus_queue.cc:1035] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:08.029541 23784 consensus_queue.cc:1035] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:08.042235 23150 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:08.042392 23150 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:08.044519 23150 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Sending DeleteTablet for 3 replicas of tablet 971feff1b51d47e7b618527cc66cf48e
I20260809 01:58:08.045138 23301 tablet_service.cc:1514] Processing DeleteTablet for tablet 971feff1b51d47e7b618527cc66cf48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47822
I20260809 01:58:08.045239 23609 tablet_service.cc:1514] Processing DeleteTablet for tablet 971feff1b51d47e7b618527cc66cf48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:51642
I20260809 01:58:08.045244 23452 tablet_service.cc:1514] Processing DeleteTablet for tablet 971feff1b51d47e7b618527cc66cf48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49156
I20260809 01:58:08.045410 23737 tablet_replica.cc:330] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: stopping tablet replica
I20260809 01:58:08.045414 23736 tablet_replica.cc:330] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: stopping tablet replica
I20260809 01:58:08.045528 23736 raft_consensus.cc:2229] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:08.045534 23737 raft_consensus.cc:2229] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:08.045645 23736 raft_consensus.cc:2258] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.045644 23737 raft_consensus.cc:2258] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.045799 23738 tablet_replica.cc:330] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: stopping tablet replica
I20260809 01:58:08.045711 23150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 01:58:08.045928 23738 raft_consensus.cc:2229] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 1 LEADER]: Raft consensus shutting down.
W20260809 01:58:08.046082 23150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:08.046217 23738 raft_consensus.cc:2258] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.046584 23737 ts_tablet_manager.cc:1905] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.047118 23736 ts_tablet_manager.cc:1905] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.049220 23737 ts_tablet_manager.cc:1918] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:08.049295 23737 log.cc:1196] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/971feff1b51d47e7b618527cc66cf48e
I20260809 01:58:08.049584 23737 ts_tablet_manager.cc:1939] T 971feff1b51d47e7b618527cc66cf48e P f6e5fe407ab049da8b779de046ad17d0: Deleting consensus metadata
I20260809 01:58:08.049635 23736 ts_tablet_manager.cc:1918] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:08.049703 23736 log.cc:1196] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/971feff1b51d47e7b618527cc66cf48e
I20260809 01:58:08.049949 23736 ts_tablet_manager.cc:1939] T 971feff1b51d47e7b618527cc66cf48e P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting consensus metadata
I20260809 01:58:08.050331 23137 catalog_manager.cc:4841] TS f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937): tablet 971feff1b51d47e7b618527cc66cf48e (table test-table [id=f157df2474a4431cbb33aeda86c731a1]) successfully deleted
I20260809 01:58:08.051086 23738 ts_tablet_manager.cc:1905] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.053313 23738 ts_tablet_manager.cc:1918] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:08.053411 23738 log.cc:1196] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/971feff1b51d47e7b618527cc66cf48e
I20260809 01:58:08.053686 23738 ts_tablet_manager.cc:1939] T 971feff1b51d47e7b618527cc66cf48e P 1048c9c2f94643fe9984a47116669862: Deleting consensus metadata
I20260809 01:58:08.054294 23138 catalog_manager.cc:4841] TS 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907): tablet 971feff1b51d47e7b618527cc66cf48e (table test-table [id=f157df2474a4431cbb33aeda86c731a1]) successfully deleted
I20260809 01:58:08.055423 23137 catalog_manager.cc:4841] TS 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573): tablet 971feff1b51d47e7b618527cc66cf48e (table test-table [id=f157df2474a4431cbb33aeda86c731a1]) successfully deleted
I20260809 01:58:08.056906 23301 tablet_service.cc:1467] Processing CreateTablet for tablet c08e6e28482647efb5e9ba6c1e868396 (DEFAULT_TABLE table=test-table [id=3d7881054ae1441bbc0fafe465f123b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:08.056962 23609 tablet_service.cc:1467] Processing CreateTablet for tablet c08e6e28482647efb5e9ba6c1e868396 (DEFAULT_TABLE table=test-table [id=3d7881054ae1441bbc0fafe465f123b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:08.057171 23301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c08e6e28482647efb5e9ba6c1e868396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:08.057193 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c08e6e28482647efb5e9ba6c1e868396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:08.058934 23711 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: Bootstrap starting.
I20260809 01:58:08.059279 23712 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Bootstrap starting.
I20260809 01:58:08.059297 23452 tablet_service.cc:1467] Processing CreateTablet for tablet c08e6e28482647efb5e9ba6c1e868396 (DEFAULT_TABLE table=test-table [id=3d7881054ae1441bbc0fafe465f123b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:08.059549 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c08e6e28482647efb5e9ba6c1e868396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:08.059808 23711 tablet_bootstrap.cc:654] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:08.060160 23712 tablet_bootstrap.cc:654] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:08.061507 23711 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: No bootstrap required, opened a new log
I20260809 01:58:08.061532 23712 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: No bootstrap required, opened a new log
I20260809 01:58:08.061589 23711 ts_tablet_manager.cc:1397] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 01:58:08.061604 23712 ts_tablet_manager.cc:1397] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 01:58:08.061946 23710 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Bootstrap starting.
I20260809 01:58:08.061985 23712 raft_consensus.cc:348] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.061985 23711 raft_consensus.cc:348] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.062086 23712 raft_consensus.cc:374] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:08.062099 23711 raft_consensus.cc:374] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:08.062119 23712 raft_consensus.cc:729] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1048c9c2f94643fe9984a47116669862, State: Initialized, Role: FOLLOWER
I20260809 01:58:08.062132 23711 raft_consensus.cc:729] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Initialized, Role: FOLLOWER
I20260809 01:58:08.062229 23712 consensus_queue.cc:260] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.062251 23711 consensus_queue.cc:260] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.062474 23712 ts_tablet_manager.cc:1428] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:58:08.062511 23711 ts_tablet_manager.cc:1428] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 01:58:08.062809 23710 tablet_bootstrap.cc:654] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:08.064644 23710 tablet_bootstrap.cc:492] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: No bootstrap required, opened a new log
I20260809 01:58:08.064738 23710 ts_tablet_manager.cc:1397] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 01:58:08.065191 23710 raft_consensus.cc:348] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.065294 23710 raft_consensus.cc:374] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:08.065332 23710 raft_consensus.cc:729] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e5fe407ab049da8b779de046ad17d0, State: Initialized, Role: FOLLOWER
I20260809 01:58:08.065444 23710 consensus_queue.cc:260] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.065733 23710 ts_tablet_manager.cc:1428] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 01:58:08.072001 23722 raft_consensus.cc:482] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:08.072099 23722 raft_consensus.cc:504] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.072458 23722 leader_election.cc:288] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:08.072788 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c08e6e28482647efb5e9ba6c1e868396" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862" is_pre_election: true
I20260809 01:58:08.072804 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c08e6e28482647efb5e9ba6c1e868396" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0" is_pre_election: true
I20260809 01:58:08.072924 23630 raft_consensus.cc:2454] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:08.072930 23474 raft_consensus.cc:2454] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 0.
I20260809 01:58:08.073192 23250 leader_election.cc:302] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d61f3073f3a40de9b0b444c37bc29bc, f6e5fe407ab049da8b779de046ad17d0; no voters:
I20260809 01:58:08.073401 23722 raft_consensus.cc:2781] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:08.073447 23722 raft_consensus.cc:482] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:08.073474 23722 raft_consensus.cc:3037] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.074481 23722 raft_consensus.cc:504] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.074841 23722 leader_election.cc:288] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Requested vote from peers f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937), 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907)
I20260809 01:58:08.075145 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c08e6e28482647efb5e9ba6c1e868396" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1048c9c2f94643fe9984a47116669862"
I20260809 01:58:08.075143 23474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c08e6e28482647efb5e9ba6c1e868396" candidate_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e5fe407ab049da8b779de046ad17d0"
I20260809 01:58:08.075241 23474 raft_consensus.cc:3037] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.075268 23630 raft_consensus.cc:3037] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:08.076076 23630 raft_consensus.cc:2454] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:08.076208 23474 raft_consensus.cc:2454] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d61f3073f3a40de9b0b444c37bc29bc in term 1.
I20260809 01:58:08.076346 23251 leader_election.cc:302] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1048c9c2f94643fe9984a47116669862, 7d61f3073f3a40de9b0b444c37bc29bc; no voters:
I20260809 01:58:08.076515 23722 raft_consensus.cc:2781] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:08.076606 23722 raft_consensus.cc:686] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Becoming Leader. State: Replica: 7d61f3073f3a40de9b0b444c37bc29bc, State: Running, Role: LEADER
I20260809 01:58:08.076728 23722 consensus_queue.cc:237] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } }
I20260809 01:58:08.078133 23151 catalog_manager.cc:5495] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193). New cstate: current_term: 1 leader_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d61f3073f3a40de9b0b444c37bc29bc" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 45573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:08.099920 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:08.096432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.14.175.193:45573)
0809 01:58:08.096539 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:08.096543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:08.096577 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:58:08.096745 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:08.096749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:08.096799 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:08.096883 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:08.097145 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.097942 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.098823 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:08.099205 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:08.099309 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:08.099509 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:08.099589 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:08.099660 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:08.099735 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 01:58:08.099783 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 01:58:08.105569 23629 raft_consensus.cc:1261] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:08.105545 23474 raft_consensus.cc:1261] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Refusing update from remote peer 7d61f3073f3a40de9b0b444c37bc29bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:08.106112 23719 consensus_queue.cc:1035] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1048c9c2f94643fe9984a47116669862" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:08.106253 23722 consensus_queue.cc:1035] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e5fe407ab049da8b779de046ad17d0" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:08.139596 23152 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:08.139762 23152 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:08.141746 23152 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2d4b15911b14705abacc21e76c26a8e: Sending DeleteTablet for 3 replicas of tablet c08e6e28482647efb5e9ba6c1e868396
I20260809 01:58:08.142268 23609 tablet_service.cc:1514] Processing DeleteTablet for tablet c08e6e28482647efb5e9ba6c1e868396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:51642
I20260809 01:58:08.142318 23452 tablet_service.cc:1514] Processing DeleteTablet for tablet c08e6e28482647efb5e9ba6c1e868396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49156
I20260809 01:58:08.142467 23738 tablet_replica.cc:330] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: stopping tablet replica
I20260809 01:58:08.142488 23737 tablet_replica.cc:330] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: stopping tablet replica
I20260809 01:58:08.142584 23738 raft_consensus.cc:2229] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:08.142586 23737 raft_consensus.cc:2229] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:08.142683 23737 raft_consensus.cc:2258] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.142683 23738 raft_consensus.cc:2258] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.143237 23301 tablet_service.cc:1514] Processing DeleteTablet for tablet c08e6e28482647efb5e9ba6c1e868396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:08 UTC) from {username='oryx', principal='oryx/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47822
I20260809 01:58:08.143414 23736 tablet_replica.cc:330] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: stopping tablet replica
I20260809 01:58:08.143536 23736 raft_consensus.cc:2229] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:08.143719 23736 raft_consensus.cc:2258] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:08.143782 23737 ts_tablet_manager.cc:1905] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.144233 23738 ts_tablet_manager.cc:1905] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.146359 23737 ts_tablet_manager.cc:1918] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:58:08.146448 23737 log.cc:1196] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/c08e6e28482647efb5e9ba6c1e868396
I20260809 01:58:08.146703 23738 ts_tablet_manager.cc:1918] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 01:58:08.146724 23737 ts_tablet_manager.cc:1939] T c08e6e28482647efb5e9ba6c1e868396 P f6e5fe407ab049da8b779de046ad17d0: Deleting consensus metadata
I20260809 01:58:08.146790 23738 log.cc:1196] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/c08e6e28482647efb5e9ba6c1e868396
I20260809 01:58:08.147090 23738 ts_tablet_manager.cc:1939] T c08e6e28482647efb5e9ba6c1e868396 P 1048c9c2f94643fe9984a47116669862: Deleting consensus metadata
I20260809 01:58:08.147451 23137 catalog_manager.cc:4841] TS f6e5fe407ab049da8b779de046ad17d0 (127.14.175.194:39937): tablet c08e6e28482647efb5e9ba6c1e868396 (table test-table [id=3d7881054ae1441bbc0fafe465f123b8]) successfully deleted
I20260809 01:58:08.147806 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23232
I20260809 01:58:08.148190 23736 ts_tablet_manager.cc:1905] T c08e6e28482647efb5e9ba6c1e868396 P 7d61f3073f3a40de9b0b444c37bc29bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:08.150847 23138 catalog_manager.cc:4841] TS 1048c9c2f94643fe9984a47116669862 (127.14.175.195:43907): tablet c08e6e28482647efb5e9ba6c1e868396 (table test-table [id=3d7881054ae1441bbc0fafe465f123b8]) successfully deleted
W20260809 01:58:08.158265 23137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:45573 (error 108)
I20260809 01:58:08.158562 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23384
I20260809 01:58:08.161989 23802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:08.161534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:45573 (local address 127.0.0.1:47866)
0809 01:58:08.161766 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:08.161854 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:45573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
W20260809 01:58:08.162137 23137 catalog_manager.cc:4584] TS 7d61f3073f3a40de9b0b444c37bc29bc (127.14.175.193:45573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c08e6e28482647efb5e9ba6c1e868396: Network error: Client connection negotiation failed: client connection to 127.14.175.193:45573: connect: Connection refused (error 111)
I20260809 01:58:08.167057 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23537
I20260809 01:58:08.174618 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23119
2026-08-09T01:58:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3008 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:58:08 dist-test-slave-2w3w krb5kdc[23805](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:58:08 dist-test-slave-2w3w krb5kdc[23805](info): set up 2 sockets
Aug 09 01:58:08 dist-test-slave-2w3w krb5kdc[23805](info): commencing operation
krb5kdc: starting...
W20260809 01:58:09.253455 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:09 dist-test-slave-2w3w krb5kdc[23805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:58:09.377588 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33927
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:33927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:09.485692 23821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:09.485937 23821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:09.485978 23821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:09.489951 23821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:09.490000 23821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:09.490018 23821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:09.490034 23821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:09.490048 23821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:09.495150 23821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:33927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:09.496071 23821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:09.496994 23821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:09.505679 23827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:09.505698 23831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:09.505757 23821 server_base.cc:1034] running on GCE node
W20260809 01:58:09.505683 23828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:09.506568 23821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:09.507686 23821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:09.508895 23821 hybrid_clock.cc:648] HybridClock initialized: now 1786240689508877 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T01:58:09Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1338 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:58:09 dist-test-slave-2w3w krb5kdc[23838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:58:09 dist-test-slave-2w3w krb5kdc[23838](info): set up 2 sockets
Aug 09 01:58:09 dist-test-slave-2w3w krb5kdc[23838](info): commencing operation
krb5kdc: starting...
W20260809 01:58:10.589821 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:10 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:58:10.712289 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32933
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:32933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:10.818209 23852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:10.818441 23852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:10.818478 23852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:10.822237 23852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:10.822283 23852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:10.822300 23852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:10.822316 23852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:10.822331 23852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:10.827349 23852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:32933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:10.828235 23852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:10.829147 23852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:10.836843 23860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:10.836871 23857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:10.836833 23858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:10.837126 23852 server_base.cc:1034] running on GCE node
I20260809 01:58:10.837771 23852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:10.838785 23852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:10.839979 23852 hybrid_clock.cc:648] HybridClock initialized: now 1786240690839977 us; error 36 us; skew 500 ppm
Aug 09 01:58:10 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240690, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:10.846889 23852 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:58:10.847764 23852 webserver.cc:460] Webserver started at http://127.14.175.254:46173/ using document root <none> and password file <none>
I20260809 01:58:10.848295 23852 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:10.848385 23852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:10.848608 23852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:10.850534 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "901ee5cbe342416dae4349e0ef30fa92"
format_stamp: "Formatted at 2026-08-09 01:58:10 on dist-test-slave-2w3w"
server_key: "d3860ae1b050de519e2d8a2491e7f42d"
server_key_iv: "82672e0dd37a66da5bcdbc2f63ed3877"
server_key_version: "encryptionkey@0"
I20260809 01:58:10.851203 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "901ee5cbe342416dae4349e0ef30fa92"
format_stamp: "Formatted at 2026-08-09 01:58:10 on dist-test-slave-2w3w"
server_key: "d3860ae1b050de519e2d8a2491e7f42d"
server_key_iv: "82672e0dd37a66da5bcdbc2f63ed3877"
server_key_version: "encryptionkey@0"
I20260809 01:58:10.854580 23852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 01:58:10.856894 23867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:10.858146 23852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:10.858290 23852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "901ee5cbe342416dae4349e0ef30fa92"
format_stamp: "Formatted at 2026-08-09 01:58:10 on dist-test-slave-2w3w"
server_key: "d3860ae1b050de519e2d8a2491e7f42d"
server_key_iv: "82672e0dd37a66da5bcdbc2f63ed3877"
server_key_version: "encryptionkey@0"
I20260809 01:58:10.858395 23852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:10.873672 23852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:10.876852 23852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:10.877048 23852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:10.883846 23852 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:32933
I20260809 01:58:10.883873 23925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:32933 every 8 connection(s)
I20260809 01:58:10.884718 23852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:10.887286 23926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:10.888299 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23852
I20260809 01:58:10.888466 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:10.888779 15039 external_mini_cluster.cc:1428] Setting key f9ac20cb9a7af47bb407a00ebbcdde07
I20260809 01:58:10.893105 23926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Bootstrap starting.
I20260809 01:58:10.895239 23926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:10.895931 23926 log.cc:824] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Log is configured to *not* fsync() on all Append() calls
Aug 09 01:58:10 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:58:10.897799 23926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: No bootstrap required, opened a new log
I20260809 01:58:10.900998 23926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:10.901216 23926 raft_consensus.cc:374] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:10.901278 23926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901ee5cbe342416dae4349e0ef30fa92, State: Initialized, Role: FOLLOWER
I20260809 01:58:10.901767 23926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:10.901923 23926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:10.902010 23926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:10.902107 23926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:10.902489 23929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:10.890144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.14.175.254:32933)
0809 01:58:10.890531 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:10.890544 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:10.890575 (+ 31us) server_negotiation.cc:407] Connection header received
0809 01:58:10.891290 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:10.891315 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:10.891613 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:10.891922 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:10.892728 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:10.893715 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:10.894557 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:10.895109 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:10.895284 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:10.897899 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:10.897905 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:10.897920 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:10.897949 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:10.899678 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:10.900121 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:10.900129 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:10.900139 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:10.900256 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:10.900541 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:10.900546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:10.900547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:10.900902 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:10.901100 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:10.901393 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 01:58:10.901669 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260809 01:58:10.903141 23926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:10.903477 23926 leader_election.cc:302] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 901ee5cbe342416dae4349e0ef30fa92; no voters:
I20260809 01:58:10.903823 23926 leader_election.cc:288] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:10.903892 23931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:10.904083 23931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 LEADER]: Becoming Leader. State: Replica: 901ee5cbe342416dae4349e0ef30fa92, State: Running, Role: LEADER
I20260809 01:58:10.904354 23931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:10.905033 23926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:10.906169 23933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "901ee5cbe342416dae4349e0ef30fa92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } } }
I20260809 01:58:10.906322 23933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:10.906623 23932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 901ee5cbe342416dae4349e0ef30fa92. Latest consensus state: current_term: 1 leader_uuid: "901ee5cbe342416dae4349e0ef30fa92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } } }
I20260809 01:58:10.906733 23932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:10.906847 23941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:10.909713 23941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:10.914314 23941 catalog_manager.cc:1347] Generated new cluster ID: ccf31fda8f2a4f638743cc392aa15cff
I20260809 01:58:10.914400 23941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:10.922503 23941 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:10.923456 23941 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:10.936254 23941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Generated new TSK 0
I20260809 01:58:10.936902 23941 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:58:10.976470 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:11.090783 23954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:11.091039 23954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:11.091084 23954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:11.094933 23954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:11.095000 23954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:11.095057 23954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:11.100903 23954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:11.101992 23954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:11.102944 23954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:11.112752 23960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:11.112752 23962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:11.112802 23959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.113181 23954 server_base.cc:1034] running on GCE node
I20260809 01:58:11.113603 23954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:11.114251 23954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:11.115455 23954 hybrid_clock.cc:648] HybridClock initialized: now 1786240691115440 us; error 30 us; skew 500 ppm
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:11.118498 23954 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:58:11.119380 23954 webserver.cc:460] Webserver started at http://127.14.175.193:39307/ using document root <none> and password file <none>
I20260809 01:58:11.119915 23954 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:11.119978 23954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:11.120143 23954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:11.122201 23954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "15385f5c3b2949789d01dbda95f4ebe5"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "6ec10d28ffa459b36788d3056c0ef0e9"
server_key_iv: "7ec5be20baee36f017177b39e330db9c"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.122816 23954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "15385f5c3b2949789d01dbda95f4ebe5"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "6ec10d28ffa459b36788d3056c0ef0e9"
server_key_iv: "7ec5be20baee36f017177b39e330db9c"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.126745 23954 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 01:58:11.129297 23970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.130506 23954 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:11.130602 23954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "15385f5c3b2949789d01dbda95f4ebe5"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "6ec10d28ffa459b36788d3056c0ef0e9"
server_key_iv: "7ec5be20baee36f017177b39e330db9c"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.130685 23954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:11.154649 23954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:11.158192 23954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:11.158373 23954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:11.158919 23954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:11.159957 23954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:11.160013 23954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.160054 23954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:11.160075 23954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.169732 23954 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:42863
I20260809 01:58:11.169761 24092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:42863 every 8 connection(s)
I20260809 01:58:11.170565 23954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:11.173457 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 23954
I20260809 01:58:11.173607 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:11.173983 15039 external_mini_cluster.cc:1428] Setting key 44eb2702d58e73994da2f92f4624dac3
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:58:11.185117 23929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.172275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:42171 (local address 127.14.175.254:32933)
0809 01:58:11.172439 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:11.172443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:11.173255 (+ 812us) server_negotiation.cc:407] Connection header received
0809 01:58:11.175008 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:11.175012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:11.175059 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:11.175145 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:11.176679 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.177190 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.178562 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.178953 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.179094 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.181472 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:11.181476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:11.181479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:11.181514 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:11.183072 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.183575 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.183580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.183582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.183668 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.184022 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.184026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.184028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.184208 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:11.184326 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:11.184802 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 01:58:11.184943 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 01:58:11.185873 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.172633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:42171)
0809 01:58:11.173064 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:11.173106 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:11.174684 (+ 1578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:11.175308 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:11.175314 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:11.175869 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:11.176518 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.176543 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.177320 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.177326 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.178430 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.178440 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.179131 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.179134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.179283 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.179902 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:11.179918 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:11.181309 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:11.183192 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.183198 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.183211 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.183466 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.183779 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.183782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.183784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.183921 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.184341 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:11.184348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:11.184572 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 01:58:11.184757 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 01:58:11.185074 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:58:11.187156 24093 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32933
I20260809 01:58:11.187394 24093 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:11.187861 24093 heartbeater.cc:511] Master 127.14.175.254:32933 requested a full tablet report, sending...
I20260809 01:58:11.189518 23886 ts_manager.cc:194] Registered new tserver with Master: 15385f5c3b2949789d01dbda95f4ebe5 (127.14.175.193:42863)
I20260809 01:58:11.191167 23886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:42171
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:58:11.204082 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:11.313222 24099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:11.313462 24099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:11.313504 24099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:11.317456 24099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:11.317507 24099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:11.317562 24099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:11.322556 24099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:11.323518 24099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:11.324431 24099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:11.333587 24106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:11.333600 24105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.333614 24099 server_base.cc:1034] running on GCE node
W20260809 01:58:11.333657 24108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.334308 24099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:11.334846 24099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:11.336028 24099 hybrid_clock.cc:648] HybridClock initialized: now 1786240691336017 us; error 22 us; skew 500 ppm
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:11.338671 24099 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:58:11.339545 24099 webserver.cc:460] Webserver started at http://127.14.175.194:34423/ using document root <none> and password file <none>
I20260809 01:58:11.340075 24099 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:11.340134 24099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:11.340354 24099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:11.342213 24099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "8942da7e195b447fa737b77a4df27c27"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "08292fc70a2e207f630d3ecdfadc22fc"
server_key_iv: "8b64b2b4dd10df52cbeb7bbe2bf66452"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.342739 24099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "8942da7e195b447fa737b77a4df27c27"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "08292fc70a2e207f630d3ecdfadc22fc"
server_key_iv: "8b64b2b4dd10df52cbeb7bbe2bf66452"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.346123 24099 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:11.348379 24116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.349493 24099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:11.349618 24099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "8942da7e195b447fa737b77a4df27c27"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "08292fc70a2e207f630d3ecdfadc22fc"
server_key_iv: "8b64b2b4dd10df52cbeb7bbe2bf66452"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.349720 24099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:11.367344 24099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:11.369982 24099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:11.370172 24099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:11.370711 24099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:11.371541 24099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:11.371609 24099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.371678 24099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:11.371729 24099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.380601 24099 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44179
I20260809 01:58:11.380650 24242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44179 every 8 connection(s)
I20260809 01:58:11.381417 24099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:58:11.390655 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24099
I20260809 01:58:11.390812 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:11.391161 15039 external_mini_cluster.cc:1428] Setting key 220305ed20040a55492714e7d0f608d6
I20260809 01:58:11.394407 23929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.383114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:41643 (local address 127.14.175.254:32933)
0809 01:58:11.383243 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:11.383246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:11.384020 (+ 774us) server_negotiation.cc:407] Connection header received
0809 01:58:11.385227 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:11.385231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:11.385290 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:11.385361 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:11.386397 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.386940 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.388090 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.388314 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.388411 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.390694 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:11.390697 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:11.390699 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:11.390724 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:11.392475 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.392961 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.392965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.392967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.393050 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.393395 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.393400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.393402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.393575 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:11.393683 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:11.394126 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 01:58:11.394244 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 01:58:11.395464 24245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.383449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:41643)
0809 01:58:11.383865 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:11.383906 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:11.385025 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:11.385487 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:11.385492 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:11.385825 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:11.386256 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.386268 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.387108 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.387110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.387958 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.387967 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.388448 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.388451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.388579 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.389084 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:11.389098 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:11.390520 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:11.392589 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.392594 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.392606 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.392856 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.393144 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.393148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.393150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.393288 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.393681 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:11.393688 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:11.393906 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 01:58:11.394084 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 01:58:11.394391 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":122,"threads_started":1}
I20260809 01:58:11.396683 24243 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32933
I20260809 01:58:11.396927 24243 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:11.397370 24243 heartbeater.cc:511] Master 127.14.175.254:32933 requested a full tablet report, sending...
I20260809 01:58:11.398433 23886 ts_manager.cc:194] Registered new tserver with Master: 8942da7e195b447fa737b77a4df27c27 (127.14.175.194:44179)
I20260809 01:58:11.399343 23886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:41643
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:58:11.421840 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:11.531920 24248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:11.532171 24248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:11.532294 24248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:11.536926 24248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:11.537002 24248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:11.537091 24248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:11.542269 24248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:11.543238 24248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:11.544142 24248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:11.553534 24253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:11.553581 24254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.553838 24248 server_base.cc:1034] running on GCE node
W20260809 01:58:11.554003 24256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.554423 24248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:11.555060 24248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:11.556219 24248 hybrid_clock.cc:648] HybridClock initialized: now 1786240691556189 us; error 46 us; skew 500 ppm
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:11.558954 24248 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:58:11.559849 24248 webserver.cc:460] Webserver started at http://127.14.175.195:42315/ using document root <none> and password file <none>
I20260809 01:58:11.560469 24248 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:11.560562 24248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:11.560772 24248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:11.562995 24248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "10ddbc1818c8483f8c6e41b6a0d7b114"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "63d68dd685ef791c4ac1abfeab6f6e1a"
server_key_iv: "0456b81b2f7b61f4c0e720c3a0e2ebcb"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.563583 24248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "10ddbc1818c8483f8c6e41b6a0d7b114"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "63d68dd685ef791c4ac1abfeab6f6e1a"
server_key_iv: "0456b81b2f7b61f4c0e720c3a0e2ebcb"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.567237 24248 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:58:11.569625 24264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.570848 24248 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:11.571009 24248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "10ddbc1818c8483f8c6e41b6a0d7b114"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "63d68dd685ef791c4ac1abfeab6f6e1a"
server_key_iv: "0456b81b2f7b61f4c0e720c3a0e2ebcb"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.571141 24248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:11.617564 24248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:11.620816 24248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:11.621047 24248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:11.621657 24248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:11.622481 24248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:11.622552 24248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.622628 24248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:11.622684 24248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.631737 24248 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:40229
I20260809 01:58:11.631769 24385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:40229 every 8 connection(s)
I20260809 01:58:11.632640 24248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:11.638772 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24248
I20260809 01:58:11.638922 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:11.639271 15039 external_mini_cluster.cc:1428] Setting key 49fca7fcafc5533660eb81d481454430
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:58:11.645870 23929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.634313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:37277 (local address 127.14.175.254:32933)
0809 01:58:11.634466 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:11.634470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:11.635375 (+ 905us) server_negotiation.cc:407] Connection header received
0809 01:58:11.636676 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:11.636679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:11.636724 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:11.636795 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:11.637914 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.638421 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.639949 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.640264 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.640358 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.642882 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:11.642884 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:11.642887 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:11.642911 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:11.644162 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.644623 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.644626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.644627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.644700 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:11.645000 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:11.645002 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:11.645003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:11.645163 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:11.645238 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:11.645664 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 01:58:11.645758 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 01:58:11.646621 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:11.634737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:37277)
0809 01:58:11.635239 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:11.635281 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:11.636482 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:11.636948 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:11.636960 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:11.637307 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:11.637786 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.637798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.638554 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.638558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.639831 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:11.639841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:11.640410 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:11.640415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:11.640583 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:11.641178 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:11.641194 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:11.642732 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:11.644266 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.644270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.644279 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.644538 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.644780 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:11.644782 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:11.644783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:11.644921 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:11.645248 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:11.645253 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:11.645461 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 01:58:11.645605 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 01:58:11.645829 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":172,"threads_started":1}
I20260809 01:58:11.647744 24386 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32933
I20260809 01:58:11.647967 24386 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:11.648408 24386 heartbeater.cc:511] Master 127.14.175.254:32933 requested a full tablet report, sending...
I20260809 01:58:11.649338 23886 ts_manager.cc:194] Registered new tserver with Master: 10ddbc1818c8483f8c6e41b6a0d7b114 (127.14.175.195:40229)
I20260809 01:58:11.649914 23886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:37277
I20260809 01:58:11.653023 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
Entry for principal oryx/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab.
WARNING: no policy specified for oryx/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
Entry for principal oryx/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab.
WARNING: no policy specified for oryx/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
Entry for principal oryx/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab.
I20260809 01:58:11.730082 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23954
I20260809 01:58:11.737509 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24099
I20260809 01:58:11.743814 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24248
I20260809 01:58:11.751891 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 23852
I20260809 01:58:11.759853 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32933
--webserver_interface=127.14.175.254
--webserver_port=46173
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:32933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:11.868922 24395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:11.869155 24395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:11.869192 24395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:11.872972 24395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:11.873016 24395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:11.873035 24395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:11.873051 24395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:11.873066 24395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:11.878032 24395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:32933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=46173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:11.878979 24395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:11.879877 24395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:11.888091 24402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:11.888101 24405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.888192 24395 server_base.cc:1034] running on GCE node
W20260809 01:58:11.888075 24401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:11.888974 24395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:11.889988 24395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:11.891170 24395 hybrid_clock.cc:648] HybridClock initialized: now 1786240691891147 us; error 49 us; skew 500 ppm
Aug 09 01:58:11 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240691, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:11.893987 24395 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:58:11.894889 24395 webserver.cc:460] Webserver started at http://127.14.175.254:46173/ using document root <none> and password file <none>
I20260809 01:58:11.895439 24395 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:11.895551 24395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:11.899199 24395 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 01:58:11.901149 24412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:11.902258 24395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:11.902396 24395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "901ee5cbe342416dae4349e0ef30fa92"
format_stamp: "Formatted at 2026-08-09 01:58:10 on dist-test-slave-2w3w"
server_key: "d3860ae1b050de519e2d8a2491e7f42d"
server_key_iv: "82672e0dd37a66da5bcdbc2f63ed3877"
server_key_version: "encryptionkey@0"
I20260809 01:58:11.902896 24395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:11.916160 24395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:11.919258 24395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:11.919454 24395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:11.926815 24395 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:32933
I20260809 01:58:11.926870 24469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:32933 every 8 connection(s)
I20260809 01:58:11.927835 24395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:11.931902 24470 sys_catalog.cc:263] Verifying existing consensus state
I20260809 01:58:11.933459 24470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Bootstrap starting.
I20260809 01:58:11.936591 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24395
I20260809 01:58:11.937150 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:42863
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:32933
--webserver_port=39307
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 01:58:11.954742 24470 log.cc:824] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:11.962937 24470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 01:58:11.963402 24470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Bootstrap complete.
I20260809 01:58:11.969213 24470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:11.969715 24470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901ee5cbe342416dae4349e0ef30fa92, State: Initialized, Role: FOLLOWER
I20260809 01:58:11.970257 24470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:11.970409 24470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:11.970475 24470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:11.970571 24470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260809 01:58:11.973060 24470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:11.973429 24470 leader_election.cc:302] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 901ee5cbe342416dae4349e0ef30fa92; no voters:
I20260809 01:58:11.973762 24470 leader_election.cc:288] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 01:58:11.973941 24475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 01:58:11.974265 24475 raft_consensus.cc:686] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [term 2 LEADER]: Becoming Leader. State: Replica: 901ee5cbe342416dae4349e0ef30fa92, State: Running, Role: LEADER
I20260809 01:58:11.974624 24475 consensus_queue.cc:237] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } }
I20260809 01:58:11.975046 24470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:11.976286 24477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 901ee5cbe342416dae4349e0ef30fa92. Latest consensus state: current_term: 2 leader_uuid: "901ee5cbe342416dae4349e0ef30fa92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } } }
I20260809 01:58:11.976337 24476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "901ee5cbe342416dae4349e0ef30fa92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901ee5cbe342416dae4349e0ef30fa92" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32933 } } }
I20260809 01:58:11.976429 24477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:11.976438 24476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:11.976804 24485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:11.979655 24485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:11.980203 24485 catalog_manager.cc:1259] Loaded cluster ID: ccf31fda8f2a4f638743cc392aa15cff
I20260809 01:58:11.980279 24485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:11.981990 24485 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:11.982550 24485 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 901ee5cbe342416dae4349e0ef30fa92: Loaded TSK: 0
I20260809 01:58:11.983680 24485 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 01:58:12.067902 24473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:12.068169 24473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:12.068245 24473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:12.072188 24473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:12.072312 24473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:12.072427 24473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:12.077832 24473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.193.keytab
--principal=oryx/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:42863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=39307
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:12.078779 24473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:12.079800 24473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:12.089133 24501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.089152 24499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.089161 24498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:12.089668 24473 server_base.cc:1034] running on GCE node
I20260809 01:58:12.090061 24473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:12.090704 24473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:12.091928 24473 hybrid_clock.cc:648] HybridClock initialized: now 1786240692091906 us; error 43 us; skew 500 ppm
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240692, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:12.094925 24473 init.cc:377] Logged in from keytab as oryx/127.14.175.193@KRBTEST.COM (short username oryx)
I20260809 01:58:12.095870 24473 webserver.cc:460] Webserver started at http://127.14.175.193:39307/ using document root <none> and password file <none>
I20260809 01:58:12.096432 24473 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:12.096505 24473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:12.100337 24473 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 01:58:12.102634 24508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.104202 24473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 01:58:12.104334 24473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "15385f5c3b2949789d01dbda95f4ebe5"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "6ec10d28ffa459b36788d3056c0ef0e9"
server_key_iv: "7ec5be20baee36f017177b39e330db9c"
server_key_version: "encryptionkey@0"
I20260809 01:58:12.105015 24473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:12.121500 24473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:12.124814 24473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:12.125047 24473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:12.125658 24473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:12.126504 24473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:12.126551 24473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.126619 24473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:12.126650 24473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.135159 24473 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:42863
I20260809 01:58:12.135229 24633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:42863 every 8 connection(s)
I20260809 01:58:12.136240 24473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:12.146265 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24473
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.146808 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:44179
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:32933
--webserver_port=34423
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.148945 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.138304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:37283)
0809 01:58:12.138745 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.138807 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.140091 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.141105 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.141117 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.141462 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.141900 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.141913 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.143152 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.143155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.144044 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.144054 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.144746 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.144748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.144906 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.145522 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.145539 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.148236 (+ 2697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":133,"threads_started":1}
W20260809 01:58:12.149395 24634 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:32933 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.175.254:32933: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
W20260809 01:58:12.149436 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.138184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:37283 (local address 127.14.175.254:32933)
0809 01:58:12.138636 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.138653 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.138921 (+ 268us) server_negotiation.cc:407] Connection header received
0809 01:58:12.140440 (+ 1519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.140451 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.140735 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.141001 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.142058 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.143022 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.144157 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.144613 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.144727 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.148538 (+ 3811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:37283: BlockingRecv error: recv got EOF from 127.14.175.193:37283 (error 108)
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":129,"threads_started":1}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.155856 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.149838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:34127)
0809 01:58:12.150050 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.150061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.150136 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.150390 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.150392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.150515 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.150599 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.150604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.151484 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.151490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.152487 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.152501 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.153014 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.153020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.153150 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.153625 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.153645 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.155683 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150}
W20260809 01:58:12.155876 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.149942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:34127 (local address 127.14.175.254:32933)
0809 01:58:12.150063 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.150069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.150108 (+ 39us) server_negotiation.cc:407] Connection header received
0809 01:58:12.150222 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.150226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.150277 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.150370 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.150710 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.151363 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.152609 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.152889 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.152968 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.155795 (+ 2827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:34127: BlockingRecv error: recv got EOF from 127.14.175.193:34127 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.162127 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.156432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:48851)
0809 01:58:12.156532 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.156546 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.156681 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.157071 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.157075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.157257 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.157383 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.157393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.158123 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.158128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.159112 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.159126 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.159556 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.159562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.159674 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.160118 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.160137 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.161996 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 01:58:12.162227 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.156511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:48851 (local address 127.14.175.254:32933)
0809 01:58:12.156879 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.156882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.156892 (+ 10us) server_negotiation.cc:407] Connection header received
0809 01:58:12.156918 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.156920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.156950 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.157010 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.157508 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.158011 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.159237 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.159438 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.159522 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.162129 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:48851: BlockingRecv error: recv got EOF from 127.14.175.193:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":242}
W20260809 01:58:12.162392 24634 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 01:58:12.258811 24639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:12.259116 24639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:12.259202 24639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:12.263406 24639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:12.263476 24639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:12.263556 24639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:12.268603 24639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.194.keytab
--principal=oryx/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:44179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=34423
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:12.269546 24639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:12.270533 24639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:12.279794 24648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.279806 24644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.279834 24645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:12.280092 24639 server_base.cc:1034] running on GCE node
I20260809 01:58:12.280450 24639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:12.280990 24639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:12.282151 24639 hybrid_clock.cc:648] HybridClock initialized: now 1786240692282134 us; error 34 us; skew 500 ppm
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240692, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:12.284817 24639 init.cc:377] Logged in from keytab as oryx/127.14.175.194@KRBTEST.COM (short username oryx)
I20260809 01:58:12.285809 24639 webserver.cc:460] Webserver started at http://127.14.175.194:34423/ using document root <none> and password file <none>
I20260809 01:58:12.286343 24639 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:12.286417 24639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:12.290026 24639 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:12.291996 24656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.293140 24639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:12.293272 24639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "8942da7e195b447fa737b77a4df27c27"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "08292fc70a2e207f630d3ecdfadc22fc"
server_key_iv: "8b64b2b4dd10df52cbeb7bbe2bf66452"
server_key_version: "encryptionkey@0"
I20260809 01:58:12.293789 24639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:12.306986 24639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:12.309875 24639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:12.310079 24639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:12.310637 24639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:12.311488 24639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:12.311563 24639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.311635 24639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:12.311679 24639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.320602 24639 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44179
I20260809 01:58:12.320633 24783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44179 every 8 connection(s)
I20260809 01:58:12.321554 24639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:12.325737 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24639
I20260809 01:58:12.326221 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:40229
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:32933
--webserver_port=42315
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 01:58:12.333588 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.323342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:37147 (local address 127.14.175.254:32933)
0809 01:58:12.323458 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.323462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.324315 (+ 853us) server_negotiation.cc:407] Connection header received
0809 01:58:12.325621 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.325625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.325688 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.325792 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.327031 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.327549 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.329284 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.329511 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.329601 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.333466 (+ 3865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:37147: BlockingRecv error: recv got EOF from 127.14.175.194:37147 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 01:58:12.334174 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.323732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:37147)
0809 01:58:12.324166 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.324208 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.325393 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.325968 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.325975 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.326312 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.326843 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.326857 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.327680 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.327684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.329142 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.329157 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.329676 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.329682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.329918 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.330565 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.330593 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.333360 (+ 2767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":120,"threads_started":1}
W20260809 01:58:12.334615 24784 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:32933 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.175.254:32933: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.340256 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.335149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:37765)
0809 01:58:12.335354 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.335367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.335466 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.335691 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.335694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.335861 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.335950 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.335955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.336682 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.336689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.337232 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.337240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.337694 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.337698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.337787 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.338267 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.338287 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.340123 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 01:58:12.340366 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.335207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:37765 (local address 127.14.175.254:32933)
0809 01:58:12.335302 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.335306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.335428 (+ 122us) server_negotiation.cc:407] Connection header received
0809 01:58:12.335548 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.335550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.335596 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.335676 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.336080 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.336581 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.337366 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.337588 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.337692 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.340238 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:37765: BlockingRecv error: recv got EOF from 127.14.175.194:37765 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.346038 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.340945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:38011)
0809 01:58:12.341088 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.341102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.341167 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.341374 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.341376 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.341542 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.341624 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.341630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.342305 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.342308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.343186 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.343196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.343610 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.343613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.343697 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.344130 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.344151 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.345927 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":87}
W20260809 01:58:12.346159 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.341031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:38011 (local address 127.14.175.254:32933)
0809 01:58:12.341132 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.341135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.341147 (+ 12us) server_negotiation.cc:407] Connection header received
0809 01:58:12.341244 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.341246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.341276 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.341340 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.341726 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.342209 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.343292 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.343501 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.343582 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.346036 (+ 2454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:38011: BlockingRecv error: recv got EOF from 127.14.175.194:38011 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 01:58:12.346206 24784 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 01:58:12.439965 24788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:12.440238 24788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:12.440280 24788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:12.444515 24788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:12.444581 24788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:12.444672 24788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:12.450059 24788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/krb5kdc/oryx_127.14.175.195.keytab
--principal=oryx/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:40229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=42315
--tserver_master_addrs=127.14.175.254:32933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:12.451143 24788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:12.452159 24788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:12.461839 24793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.461839 24796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:12.461836 24794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:12.462165 24788 server_base.cc:1034] running on GCE node
I20260809 01:58:12.462587 24788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:12.463249 24788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:12.464407 24788 hybrid_clock.cc:648] HybridClock initialized: now 1786240692464377 us; error 47 us; skew 500 ppm
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240692, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:12.467162 24788 init.cc:377] Logged in from keytab as oryx/127.14.175.195@KRBTEST.COM (short username oryx)
I20260809 01:58:12.467979 24788 webserver.cc:460] Webserver started at http://127.14.175.195:42315/ using document root <none> and password file <none>
I20260809 01:58:12.468501 24788 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:12.468611 24788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:12.472236 24788 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 01:58:12.474272 24803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.475687 24788 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 01:58:12.475840 24788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "10ddbc1818c8483f8c6e41b6a0d7b114"
format_stamp: "Formatted at 2026-08-09 01:58:11 on dist-test-slave-2w3w"
server_key: "63d68dd685ef791c4ac1abfeab6f6e1a"
server_key_iv: "0456b81b2f7b61f4c0e720c3a0e2ebcb"
server_key_version: "encryptionkey@0"
I20260809 01:58:12.476424 24788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:12.500880 24788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:12.503846 24788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:12.504053 24788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:12.504674 24788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:12.505576 24788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:12.505646 24788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.505714 24788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:12.505764 24788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:12.515568 24788 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:40229
I20260809 01:58:12.515609 24929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:40229 every 8 connection(s)
I20260809 01:58:12.516546 24788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:12.523865 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 24788
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 01:58:12.528975 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.518346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:45961 (local address 127.14.175.254:32933)
0809 01:58:12.518512 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.518516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.519394 (+ 878us) server_negotiation.cc:407] Connection header received
0809 01:58:12.520806 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.520810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.520869 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.520969 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.522197 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.522775 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.524310 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.524668 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.524783 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.528830 (+ 4047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:45961: BlockingRecv error: recv got EOF from 127.14.175.195:45961 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 01:58:12.529520 24932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.518723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:45961)
0809 01:58:12.519239 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.519283 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.520566 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.521160 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.521167 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.521538 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.522034 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.522047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.522917 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.522921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.524157 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.524169 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.524945 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.524948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.525149 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.525899 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.525924 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.528660 (+ 2736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":120,"threads_started":1}
W20260809 01:58:12.530112 24930 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:32933 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.175.254:32933: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
I20260809 01:58:12.535094 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.524909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.14.175.254:32933)
0809 01:58:12.525176 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.525181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.525194 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:58:12.525230 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.525232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.525299 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.525403 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.526440 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.527076 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.528265 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.528605 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.528708 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.530552 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:12.530559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:12.530577 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:12.530610 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:12.532609 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:12.533078 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:12.533084 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:12.533090 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:12.533252 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:12.533601 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:12.533603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:12.533605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:12.534084 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:12.534315 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:12.534621 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 01:58:12.534899 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":102,"threads_started":1}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.536353 24932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.530605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:48485)
0809 01:58:12.530773 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.530789 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.530869 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.531199 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.531202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.531369 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.531487 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.531495 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.532377 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.532383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.533113 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.533123 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.533739 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.533743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.533834 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.534304 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.534318 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.536271 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105}
W20260809 01:58:12.536558 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.530706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48485 (local address 127.14.175.254:32933)
0809 01:58:12.530819 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.530823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.530839 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:58:12.531008 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.531013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.531061 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.531150 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.531623 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.532253 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.533239 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.533622 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.533714 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.536452 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:48485: BlockingRecv error: recv got EOF from 127.14.175.195:48485 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:12 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:12.542119 24932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:12.537069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:58539)
0809 01:58:12.537197 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:12.537214 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:12.537593 (+ 379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:12.538011 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:12.538013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:12.538147 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:12.538213 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.538217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.538885 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.538888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.539493 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:12.539501 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.539882 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.539885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:12.539942 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.540372 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:12.540384 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:12.542036 (+ 1652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 01:58:12.542295 24637 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:12.537291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:58539 (local address 127.14.175.254:32933)
0809 01:58:12.537524 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:12.537529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:12.537547 (+ 18us) server_negotiation.cc:407] Connection header received
0809 01:58:12.537703 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:12.537706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:12.537744 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:12.537886 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:12.538310 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.538766 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.539591 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:12.539786 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:12.539862 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:12.542169 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:58539: BlockingRecv error: recv got EOF from 127.14.175.195:58539 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
W20260809 01:58:12.542302 24930 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:13.168437 24935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:13.163056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:59417)
0809 01:58:13.163354 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:13.163367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:13.163451 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:13.163671 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:13.163673 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:13.163850 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:13.163966 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.163971 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.164747 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.164750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.165324 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.165333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.165766 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.165769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.165843 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.166335 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:13.166346 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:13.168273 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":107,"threads_started":1}
W20260809 01:58:13.168571 24937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:13.163101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:59417 (local address 127.14.175.254:32933)
0809 01:58:13.163413 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:13.163416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:13.163430 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:13.163536 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:13.163538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:13.163582 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:13.163660 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:13.164104 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.164648 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.165437 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.165666 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.165747 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.168415 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:59417: BlockingRecv error: recv got EOF from 127.14.175.193:59417 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":81,"threads_started":1}
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:13.352627 24938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:13.346745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:53887)
0809 01:58:13.347042 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:13.347057 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:13.347186 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:13.347472 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:13.347475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:13.347680 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:13.347814 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.347821 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.348723 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.348729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.349571 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.349580 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.350017 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.350021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.350103 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.350631 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:13.350643 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:13.352521 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
W20260809 01:58:13.352766 24937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:13.346804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53887 (local address 127.14.175.254:32933)
0809 01:58:13.347000 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:13.347005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:13.347136 (+ 131us) server_negotiation.cc:407] Connection header received
0809 01:58:13.347306 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:13.347309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:13.347357 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:13.347453 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:13.347943 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.348601 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.349674 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.349893 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.349973 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.352648 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:53887: BlockingRecv error: recv got EOF from 127.14.175.194:53887 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:13.548586 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:13.542859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:47587)
0809 01:58:13.543187 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:13.543205 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:13.543345 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:13.543631 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:13.543634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:13.543849 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:13.543949 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.543954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.544724 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.544730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.545321 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:13.545328 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.545807 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.545810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:13.545897 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.546467 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:13.546480 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:13.548393 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":109,"threads_started":1}
W20260809 01:58:13.548635 24937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:13.543020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:47587 (local address 127.14.175.254:32933)
0809 01:58:13.543168 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:13.543173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:13.543293 (+ 120us) server_negotiation.cc:407] Connection header received
0809 01:58:13.543454 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:13.543457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:13.543508 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:13.543606 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:13.544077 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.544613 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.545446 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:13.545690 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:13.545803 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:13.548524 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:47587: BlockingRecv error: recv got EOF from 127.14.175.195:47587 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:14.174731 24940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:14.169165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:38861)
0809 01:58:14.169452 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:14.169465 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:14.169562 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:14.169801 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:14.169803 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:14.169988 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:14.170085 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.170090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.170817 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.170820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.171420 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.171429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.171874 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.171876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.171939 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.172534 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:14.172551 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:14.174554 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":94,"threads_started":1}
W20260809 01:58:14.174820 24941 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:14.169240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38861 (local address 127.14.175.254:32933)
0809 01:58:14.169476 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:14.169479 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:14.169517 (+ 38us) server_negotiation.cc:407] Connection header received
0809 01:58:14.169644 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:14.169646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:14.169691 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:14.169769 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:14.170186 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.170711 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.171537 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.171771 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.171850 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.174679 (+ 2829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:38861: BlockingRecv error: recv got EOF from 127.14.175.193:38861 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:14.359120 24942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:14.353433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:55377)
0809 01:58:14.353716 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:14.353729 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:14.353835 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:14.354057 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:14.354059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:14.354234 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:14.354357 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.354365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.355506 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.355513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.356085 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.356093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.356492 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.356494 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.356555 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.357021 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:14.357033 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:14.358926 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":109,"threads_started":1}
W20260809 01:58:14.359218 24941 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:14.353532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:55377 (local address 127.14.175.254:32933)
0809 01:58:14.353678 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:14.353682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:14.353805 (+ 123us) server_negotiation.cc:407] Connection header received
0809 01:58:14.353903 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:14.353905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:14.353948 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:14.354028 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:14.354506 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.355387 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.356185 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.356395 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.356474 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.359097 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:55377: BlockingRecv error: recv got EOF from 127.14.175.194:55377 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:14.554895 24943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:14.549436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:35309)
0809 01:58:14.549696 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:14.549712 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:14.549867 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:14.550174 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:14.550176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:14.550358 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:14.550453 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.550458 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.551196 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.551198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.551766 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:14.551773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.552237 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.552240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:14.552306 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.552782 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:14.552794 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:14.554712 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
W20260809 01:58:14.555151 24941 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:14.549550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:35309 (local address 127.14.175.254:32933)
0809 01:58:14.549696 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:14.549702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:14.549800 (+ 98us) server_negotiation.cc:407] Connection header received
0809 01:58:14.549991 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:14.549996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:14.550057 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:14.550136 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:14.550558 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.551103 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.551905 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:14.552133 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:14.552211 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:14.554891 (+ 2680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:35309: BlockingRecv error: recv got EOF from 127.14.175.195:35309 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:15.180963 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:15.175547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:38791)
0809 01:58:15.175848 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:15.175862 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:15.176000 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:15.176221 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:15.176223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:15.176407 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:15.176505 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.176511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.177383 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.177385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.177984 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.177992 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.178399 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.178402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.178464 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.178908 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:15.178919 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:15.180839 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":117,"threads_started":1}
W20260809 01:58:15.181113 24945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:15.175626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38791 (local address 127.14.175.254:32933)
0809 01:58:15.175940 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:15.175944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:15.175963 (+ 19us) server_negotiation.cc:407] Connection header received
0809 01:58:15.176068 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:15.176071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:15.176112 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:15.176189 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:15.176606 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.177283 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.178084 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.178304 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.178378 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.180973 (+ 2595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:38791: BlockingRecv error: recv got EOF from 127.14.175.193:38791 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:15.365248 24946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:15.359960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:41665)
0809 01:58:15.360228 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:15.360243 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:15.360356 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:15.360593 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:15.360595 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:15.360771 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:15.360873 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.360879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.361646 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.361649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.362234 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.362243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.362671 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.362673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.362740 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.363334 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:15.363347 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:15.365122 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
W20260809 01:58:15.365397 24945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:15.360021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:41665 (local address 127.14.175.254:32933)
0809 01:58:15.360167 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:15.360171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:15.360317 (+ 146us) server_negotiation.cc:407] Connection header received
0809 01:58:15.360429 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:15.360432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:15.360475 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:15.360551 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:15.360971 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.361501 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.362345 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.362567 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.362638 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.365263 (+ 2625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:41665: BlockingRecv error: recv got EOF from 127.14.175.194:41665 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:15.561021 24947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:15.555619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:60149)
0809 01:58:15.555887 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:15.555901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:15.555997 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:15.556242 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:15.556244 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:15.556423 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:15.556525 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.556531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.557358 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.557360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.557912 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:15.557919 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.558358 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.558360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:15.558420 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.558982 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:15.558995 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:15.560903 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
W20260809 01:58:15.561210 24945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:15.555755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:60149 (local address 127.14.175.254:32933)
0809 01:58:15.555896 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:15.555899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:15.555953 (+ 54us) server_negotiation.cc:407] Connection header received
0809 01:58:15.556088 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:15.556090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:15.556135 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:15.556202 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:15.556681 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.557254 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.558026 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:15.558254 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:15.558339 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:15.561052 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:60149: BlockingRecv error: recv got EOF from 127.14.175.195:60149 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:16.190939 24948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:16.181824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:47749)
0809 01:58:16.182214 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:16.182227 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:16.182321 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:16.182628 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:16.182631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:16.182842 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:16.182937 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.182942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.183797 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.183803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.184373 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.184382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.184865 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.184868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.184958 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.188985 (+ 4027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:16.188997 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:16.190825 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":83,"threads_started":1}
W20260809 01:58:16.191184 24949 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:16.181882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:47749 (local address 127.14.175.254:32933)
0809 01:58:16.182131 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:16.182134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:16.182310 (+ 176us) server_negotiation.cc:407] Connection header received
0809 01:58:16.182433 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:16.182435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:16.182483 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:16.182603 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:16.183128 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.183685 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.184499 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.184740 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.184849 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.191027 (+ 6178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:47749: BlockingRecv error: recv got EOF from 127.14.175.193:47749 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:16.371366 24950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:16.366040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:51151)
0809 01:58:16.366328 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:16.366342 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:16.366437 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:16.366685 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:16.366687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:16.366864 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:16.367015 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.367026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.367855 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.367858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.368405 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.368413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.368831 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.368833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.368894 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.369480 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:16.369492 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:16.371252 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":108,"threads_started":1}
W20260809 01:58:16.371529 24949 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:16.366096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:51151 (local address 127.14.175.254:32933)
0809 01:58:16.366237 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:16.366240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:16.366411 (+ 171us) server_negotiation.cc:407] Connection header received
0809 01:58:16.366517 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:16.366519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:16.366563 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:16.366646 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:16.367167 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.367751 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.368511 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.368736 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.368819 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.371402 (+ 2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:51151: BlockingRecv error: recv got EOF from 127.14.175.194:51151 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:16.567162 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:16.561871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:47257)
0809 01:58:16.562158 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:16.562172 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:16.562271 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:16.562500 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:16.562502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:16.562680 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:16.562779 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.562784 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.563556 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.563559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.564147 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:16.564156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.564565 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.564568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:16.564631 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.565113 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:16.565124 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:16.567047 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":107,"threads_started":1}
W20260809 01:58:16.567262 24949 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:16.561946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:47257 (local address 127.14.175.254:32933)
0809 01:58:16.562099 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:16.562102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:16.562237 (+ 135us) server_negotiation.cc:407] Connection header received
0809 01:58:16.562340 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:16.562342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:16.562389 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:16.562455 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:16.562890 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.563438 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.564256 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:16.564467 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:16.564547 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:16.567128 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:47257: BlockingRecv error: recv got EOF from 127.14.175.195:47257 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:17.197114 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:17.191868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:35089)
0809 01:58:17.192148 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:17.192165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:17.192262 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:17.192496 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:17.192498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:17.192693 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:17.192786 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.192791 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.193630 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.193632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.194169 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.194176 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.194598 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.194600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.194661 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.195163 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:17.195174 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:17.196990 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
W20260809 01:58:17.197253 24953 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:17.191997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35089 (local address 127.14.175.254:32933)
0809 01:58:17.192254 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:17.192257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:17.192271 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:17.192339 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:17.192341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:17.192384 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:17.192453 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:17.193014 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.193539 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.194265 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.194501 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.194578 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.197125 (+ 2547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:35089: BlockingRecv error: recv got EOF from 127.14.175.193:35089 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":94,"threads_started":1}
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:17.378005 24954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:17.372167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:49863)
0809 01:58:17.372464 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:17.372481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:17.372626 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:17.372897 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:17.372899 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:17.373115 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:17.373211 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.373217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.374003 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.374006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.374652 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.374662 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.375219 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.375223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.375308 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.375902 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:17.375914 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:17.377839 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":106,"threads_started":1}
W20260809 01:58:17.378099 24953 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:17.372318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:49863 (local address 127.14.175.254:32933)
0809 01:58:17.372466 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:17.372472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:17.372568 (+ 96us) server_negotiation.cc:407] Connection header received
0809 01:58:17.372724 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:17.372727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:17.372777 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:17.372876 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:17.373332 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.373885 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.374780 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.375102 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.375217 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.377968 (+ 2751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:49863: BlockingRecv error: recv got EOF from 127.14.175.194:49863 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:17 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:17.573580 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:17.568072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:48251)
0809 01:58:17.568390 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:17.568403 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:17.568498 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:17.568807 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:17.568810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:17.569011 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:17.569109 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.569114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.569872 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.569875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.570461 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:17.570469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.570934 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.570936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:17.571088 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.571563 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:17.571574 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:17.573448 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":130,"threads_started":1}
W20260809 01:58:17.573829 24953 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:17.568140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48251 (local address 127.14.175.254:32933)
0809 01:58:17.568291 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:17.568295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:17.568459 (+ 164us) server_negotiation.cc:407] Connection header received
0809 01:58:17.568633 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:17.568636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:17.568684 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:17.568759 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:17.569219 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.569753 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.570603 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:17.570825 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:17.570912 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:17.573666 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:48251: BlockingRecv error: recv got EOF from 127.14.175.195:48251 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:18.203300 24956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:18.197910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:33043)
0809 01:58:18.198206 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:18.198219 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:18.198317 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:18.198565 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:18.198567 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:18.198752 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:18.198849 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.198853 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.199594 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.199597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.200164 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.200171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.200580 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.200582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.200643 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.201162 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:18.201173 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:18.203186 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":88,"threads_started":1}
W20260809 01:58:18.203451 24957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:18.197967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:33043 (local address 127.14.175.254:32933)
0809 01:58:18.198232 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:18.198236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:18.198292 (+ 56us) server_negotiation.cc:407] Connection header received
0809 01:58:18.198399 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:18.198402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:18.198448 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:18.198524 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:18.198950 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.199500 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.200268 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.200486 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.200561 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.203315 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:33043: BlockingRecv error: recv got EOF from 127.14.175.193:33043 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":81,"threads_started":1}
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:18.384800 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:18.378802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:52657)
0809 01:58:18.379120 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:18.379142 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:18.379282 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:18.379585 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:18.379588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:18.379808 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:18.379903 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.379909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.380757 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.380762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.381379 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.381388 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.381840 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.381844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.381930 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.382457 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:18.382468 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:18.384636 (+ 2168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":170,"threads_started":1}
W20260809 01:58:18.384868 24957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:18.378880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:52657 (local address 127.14.175.254:32933)
0809 01:58:18.379091 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:18.379096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:18.379220 (+ 124us) server_negotiation.cc:407] Connection header received
0809 01:58:18.379394 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:18.379397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:18.379455 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:18.379563 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:18.380036 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.380629 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.381495 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.381721 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.381826 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.384758 (+ 2932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:52657: BlockingRecv error: recv got EOF from 127.14.175.194:52657 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:18 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:18.580453 24959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:18.574351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:50813)
0809 01:58:18.574634 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:18.574655 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:18.574818 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:18.575108 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:18.575111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:18.575376 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:18.575518 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.575525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.576339 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.576343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.577109 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:18.577118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.577569 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.577573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:18.577657 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.578277 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:18.578293 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:18.580285 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":85,"threads_started":1}
W20260809 01:58:18.580534 24957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:18.574411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:50813 (local address 127.14.175.254:32933)
0809 01:58:18.574603 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:18.574608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:18.574733 (+ 125us) server_negotiation.cc:407] Connection header received
0809 01:58:18.574920 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:18.574924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:18.574995 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:18.575086 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:18.575651 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.576232 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.577225 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:18.577450 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:18.577566 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:18.580404 (+ 2838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:50813: BlockingRecv error: recv got EOF from 127.14.175.195:50813 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:19.210144 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:19.204229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:38527)
0809 01:58:19.204550 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:19.204564 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:19.204655 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:19.204910 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:19.204912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:19.205110 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:19.205209 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.205214 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.206065 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.206069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.206632 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.206640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.207195 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.207198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.207287 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.207908 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:19.207925 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:19.210029 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":90,"threads_started":1}
W20260809 01:58:19.210345 24962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:19.204291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38527 (local address 127.14.175.254:32933)
0809 01:58:19.204631 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:19.204635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:19.204649 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:19.204740 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:19.204742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:19.204785 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:19.204876 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:19.205329 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.205948 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.206754 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.207035 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.207157 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.210168 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:38527: BlockingRecv error: recv got EOF from 127.14.175.193:38527 (error 108)
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":193,"threads_started":1}
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:19.391238 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:19.385587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:43407)
0809 01:58:19.385923 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:19.385936 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:19.386080 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:19.386355 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:19.386357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:19.386574 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:19.386667 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.386673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.387517 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.387523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.388095 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.388103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.388591 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.388594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.388684 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.389228 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:19.389241 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:19.391127 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":85,"threads_started":1}
W20260809 01:58:19.391422 24962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:19.385671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:43407 (local address 127.14.175.254:32933)
0809 01:58:19.385852 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:19.385857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:19.386013 (+ 156us) server_negotiation.cc:407] Connection header received
0809 01:58:19.386182 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:19.386186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:19.386240 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:19.386331 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:19.386789 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.387401 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.388218 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.388458 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.388576 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.391261 (+ 2685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:43407: BlockingRecv error: recv got EOF from 127.14.175.194:43407 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:19 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:19.586944 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:19.581217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:58181)
0809 01:58:19.581544 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:19.581557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:19.581659 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:19.581920 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:19.581922 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:19.582117 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:19.582212 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.582217 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.582955 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.583019 (+ 64us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.583569 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:19.583577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.584076 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.584078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:19.584141 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.584762 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:19.584776 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:19.586790 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":86,"threads_started":1}
W20260809 01:58:19.587250 24962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:19.581272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:58181 (local address 127.14.175.254:32933)
0809 01:58:19.581406 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:19.581410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:19.581623 (+ 213us) server_negotiation.cc:407] Connection header received
0809 01:58:19.581736 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:19.581738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:19.581811 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:19.581882 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:19.582313 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.582861 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.583691 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:19.583948 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:19.584031 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:19.586933 (+ 2902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:58181: BlockingRecv error: recv got EOF from 127.14.175.195:58181 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:20.216446 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:20.210893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:41877)
0809 01:58:20.211213 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:20.211226 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:20.211316 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:20.211541 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:20.211543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:20.211724 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:20.211822 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.211827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.212562 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.212565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.213115 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.213122 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.213623 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.213628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.213716 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.214390 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:20.214405 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:20.216333 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":141,"threads_started":1}
W20260809 01:58:20.216639 24968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:20.211054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:41877 (local address 127.14.175.254:32933)
0809 01:58:20.211316 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:20.211321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:20.211335 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:20.211388 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:20.211390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:20.211431 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:20.211501 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:20.211929 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.212463 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.213222 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.213454 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.213585 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.216468 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:41877: BlockingRecv error: recv got EOF from 127.14.175.193:41877 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":114,"threads_started":1}
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:20.397908 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:20.392026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:40607)
0809 01:58:20.392297 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:20.392311 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:20.392408 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:20.392638 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:20.392640 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:20.392826 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:20.392925 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.392930 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.393879 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.393882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.394441 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.394449 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.394917 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.394920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.395064 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.395534 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:20.395545 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:20.397787 (+ 2242us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":97,"threads_started":1}
W20260809 01:58:20.398056 24968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:20.392119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:40607 (local address 127.14.175.254:32933)
0809 01:58:20.392257 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:20.392261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:20.392381 (+ 120us) server_negotiation.cc:407] Connection header received
0809 01:58:20.392487 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:20.392489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:20.392532 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:20.392602 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:20.393025 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.393766 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.394551 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.394782 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.394891 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.397935 (+ 3044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:40607: BlockingRecv error: recv got EOF from 127.14.175.194:40607 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:20 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:20.593082 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:20.587687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:59589)
0809 01:58:20.587943 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:20.587956 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:20.588061 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:20.588290 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:20.588292 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:20.588470 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:20.588565 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.588570 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.589313 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.589315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.589858 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:20.589865 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.590285 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.590288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:20.590350 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.590880 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:20.590891 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:20.592957 (+ 2066us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":89,"threads_started":1}
W20260809 01:58:20.593195 24968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:20.587760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:59589 (local address 127.14.175.254:32933)
0809 01:58:20.587893 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:20.587897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:20.588058 (+ 161us) server_negotiation.cc:407] Connection header received
0809 01:58:20.588142 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:20.588145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:20.588193 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:20.588253 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:20.588665 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.589218 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.589969 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:20.590183 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:20.590262 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:20.593101 (+ 2839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:59589: BlockingRecv error: recv got EOF from 127.14.175.195:59589 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:21.226101 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:21.217211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:44801)
0809 01:58:21.217485 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:21.217498 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:21.217586 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:21.217810 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:21.217812 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:21.217987 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:21.218093 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.218098 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.218816 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.218818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.219439 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.219449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.219929 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.219932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.219995 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.223686 (+ 3691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:21.223698 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:21.225979 (+ 2281us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":91,"threads_started":1}
W20260809 01:58:21.226303 24973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:21.217293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:44801 (local address 127.14.175.254:32933)
0809 01:58:21.217560 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:21.217563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:21.217577 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:21.217678 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:21.217680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:21.217724 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:21.217799 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:21.218191 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.218724 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.219554 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.219789 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.219894 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.226120 (+ 6226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:44801: BlockingRecv error: recv got EOF from 127.14.175.193:44801 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":111,"threads_started":1}
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:21.404014 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:21.398667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:44377)
0809 01:58:21.398972 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:21.398986 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:21.399085 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:21.399316 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:21.399318 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:21.399496 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:21.399600 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.399605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.400340 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.400343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.400927 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.400934 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.401366 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.401369 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.401432 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.401928 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:21.401938 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:21.403902 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":121,"threads_started":1}
W20260809 01:58:21.404318 24973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:21.398750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:44377 (local address 127.14.175.254:32933)
0809 01:58:21.398913 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:21.398918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:21.399060 (+ 142us) server_negotiation.cc:407] Connection header received
0809 01:58:21.399166 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:21.399168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:21.399212 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:21.399294 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:21.399707 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.400237 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.401032 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.401251 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.401341 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.404091 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:44377: BlockingRecv error: recv got EOF from 127.14.175.194:44377 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:21 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:21.599436 24975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:21.593926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:46385)
0809 01:58:21.594171 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:21.594185 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:21.594280 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:21.594499 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:21.594501 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:21.594685 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:21.594794 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.594799 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.595573 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.595576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.596136 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:21.596143 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.596560 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.596563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:21.596678 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.597297 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:21.597310 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:21.599298 (+ 1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":69,"threads_started":1}
W20260809 01:58:21.599572 24973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:21.594034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:46385 (local address 127.14.175.254:32933)
0809 01:58:21.594202 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:21.594205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:21.594235 (+ 30us) server_negotiation.cc:407] Connection header received
0809 01:58:21.594351 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:21.594353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:21.594396 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:21.594462 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:21.594899 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.595480 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.596240 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:21.596464 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:21.596541 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:21.599438 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:46385: BlockingRecv error: recv got EOF from 127.14.175.195:46385 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:22.232558 24976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:22.226920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:58659)
0809 01:58:22.227244 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:22.227257 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:22.227350 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:22.227576 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:22.227578 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:22.227759 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:22.227856 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.227861 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.228598 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.228604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.229333 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.229344 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.229893 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.229896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.229980 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.230472 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:22.230484 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:22.232381 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":94,"threads_started":1}
W20260809 01:58:22.232725 24977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:22.227000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:58659 (local address 127.14.175.254:32933)
0809 01:58:22.227242 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:22.227246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:22.227314 (+ 68us) server_negotiation.cc:407] Connection header received
0809 01:58:22.227414 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:22.227416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:22.227459 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:22.227540 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:22.227958 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.228482 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.229459 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.229775 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.229888 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.232583 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:58659: BlockingRecv error: recv got EOF from 127.14.175.193:58659 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":92,"threads_started":1}
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:22.410862 24978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:22.404906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:42393)
0809 01:58:22.405162 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:22.405177 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:22.405269 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:22.405570 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:22.405573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:22.405755 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:22.406034 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.406043 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.406850 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.406853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.407509 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.407518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.407923 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.407926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.408036 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.408526 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:22.408537 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:22.410694 (+ 2157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":101,"threads_started":1}
W20260809 01:58:22.410910 24977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:22.404968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:42393 (local address 127.14.175.254:32933)
0809 01:58:22.405113 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:22.405117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:22.405245 (+ 128us) server_negotiation.cc:407] Connection header received
0809 01:58:22.405346 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:22.405348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:22.405405 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:22.405548 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:22.406151 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.406737 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.407609 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.407825 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.407904 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.410820 (+ 2916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:42393: BlockingRecv error: recv got EOF from 127.14.175.194:42393 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:22 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:22.606204 24979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:22.600379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:48531)
0809 01:58:22.600701 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:22.600721 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:22.600867 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:22.601152 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:22.601154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:22.601383 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:22.601476 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.601481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.602230 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.602235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.602801 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:22.602808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.603328 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.603331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:22.603423 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.603939 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:22.603958 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:22.606090 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":111,"threads_started":1}
W20260809 01:58:22.606451 24977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:22.600561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:48531 (local address 127.14.175.254:32933)
0809 01:58:22.600711 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:22.600718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:22.600842 (+ 124us) server_negotiation.cc:407] Connection header received
0809 01:58:22.600985 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:22.600988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:22.601044 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:22.601128 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:22.601595 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.602122 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.602940 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:22.603208 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:22.603318 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:22.606226 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:48531: BlockingRecv error: recv got EOF from 127.14.175.195:48531 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:23.241972 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:23.233330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:46181)
0809 01:58:23.233592 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:23.233607 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:23.233696 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:23.233939 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:23.233941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:23.234119 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:23.234217 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.234222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.234954 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.234991 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.235661 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.235672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.236108 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.236110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.236170 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.239982 (+ 3812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:23.239993 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:23.241841 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":70,"threads_started":1}
W20260809 01:58:23.242223 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:23.233420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:46181 (local address 127.14.175.254:32933)
0809 01:58:23.233660 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:23.233664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:23.233678 (+ 14us) server_negotiation.cc:407] Connection header received
0809 01:58:23.233781 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:23.233783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:23.233826 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:23.233899 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:23.234316 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.234863 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.235769 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.236012 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.236092 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.242059 (+ 5967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:46181: BlockingRecv error: recv got EOF from 127.14.175.193:46181 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":79,"threads_started":1}
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:23.416908 24983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:23.411685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:46013)
0809 01:58:23.411979 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:23.411997 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:23.412100 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:23.412314 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:23.412317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:23.412498 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:23.412593 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.412599 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.413324 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.413328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.413926 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.413936 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.414346 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.414348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.414414 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.414887 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:23.414899 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:23.416774 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":111,"threads_started":1}
W20260809 01:58:23.416999 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:23.411769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:46013 (local address 127.14.175.254:32933)
0809 01:58:23.411957 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:23.411961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:23.412072 (+ 111us) server_negotiation.cc:407] Connection header received
0809 01:58:23.412166 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:23.412168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:23.412212 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:23.412279 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:23.412691 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.413203 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.414034 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.414249 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.414323 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.416909 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:46013: BlockingRecv error: recv got EOF from 127.14.175.194:46013 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:23 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:23.612977 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:23.607070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:33391)
0809 01:58:23.607356 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:23.607370 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:23.607507 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:23.607782 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:23.607785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:23.608035 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:23.608131 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.608137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.608972 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.608978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.609607 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:23.609615 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.610089 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.610093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:23.610180 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.610715 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:23.610726 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:23.612813 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":89,"threads_started":1}
W20260809 01:58:23.613317 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:23.607139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33391 (local address 127.14.175.254:32933)
0809 01:58:23.607277 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:23.607282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:23.607445 (+ 163us) server_negotiation.cc:407] Connection header received
0809 01:58:23.607608 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:23.607611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:23.607665 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:23.607761 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:23.608250 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.608862 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.609730 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:23.609973 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:23.610084 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:23.612980 (+ 2896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:33391: BlockingRecv error: recv got EOF from 127.14.175.195:33391 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:24.247903 24985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:24.242772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:36783)
0809 01:58:24.243115 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:24.243128 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:24.243224 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:24.243466 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:24.243468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:24.243648 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:24.243745 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.243750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.244459 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.244461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.245038 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.245046 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.245452 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.245455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.245514 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.246012 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:24.246024 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:24.247788 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":91,"threads_started":1}
W20260809 01:58:24.248093 24986 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:24.242835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:36783 (local address 127.14.175.254:32933)
0809 01:58:24.243130 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:24.243134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:24.243199 (+ 65us) server_negotiation.cc:407] Connection header received
0809 01:58:24.243301 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:24.243303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:24.243346 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:24.243423 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:24.243845 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.244370 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.245139 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.245358 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.245436 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.247923 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:36783: BlockingRecv error: recv got EOF from 127.14.175.193:36783 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":67,"threads_started":1}
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:24.423463 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:24.417740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:50331)
0809 01:58:24.418112 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:24.418129 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:24.418250 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:24.418541 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:24.418544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:24.418761 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:24.418857 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.418863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.419688 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.419693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.420289 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.420298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.420796 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.420799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.420888 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.421405 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:24.421416 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:24.423300 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":130,"threads_started":1}
W20260809 01:58:24.423563 24986 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:24.417950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:50331 (local address 127.14.175.254:32933)
0809 01:58:24.418106 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:24.418111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:24.418190 (+ 79us) server_negotiation.cc:407] Connection header received
0809 01:58:24.418365 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:24.418370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:24.418423 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:24.418524 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:24.419008 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.419574 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.420440 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.420677 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.420791 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.423426 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:50331: BlockingRecv error: recv got EOF from 127.14.175.194:50331 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:24 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:24.619963 24988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:24.613693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:44587)
0809 01:58:24.614024 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:24.614037 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:24.614173 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:24.614447 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:24.614450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:24.614650 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:24.614743 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.614748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.615620 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.615625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.616242 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:24.616251 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.617034 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.617038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:24.617132 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.617736 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:24.617748 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:24.619852 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":84,"threads_started":1}
W20260809 01:58:24.620144 24986 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:24.613819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:44587 (local address 127.14.175.254:32933)
0809 01:58:24.613976 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:24.613981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:24.614112 (+ 131us) server_negotiation.cc:407] Connection header received
0809 01:58:24.614277 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:24.614281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:24.614334 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:24.614416 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:24.614902 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.615506 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.616525 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:24.616768 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:24.617040 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:24.619986 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:44587: BlockingRecv error: recv got EOF from 127.14.175.195:44587 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:25.254287 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:25.248801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:43875)
0809 01:58:25.249109 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:25.249126 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:25.249242 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:25.249575 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:25.249577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:25.249762 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:25.249899 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.249904 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.250615 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.250617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.251200 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.251209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.251640 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.251642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.251705 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.252341 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:25.252354 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:25.254175 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":105,"threads_started":1}
W20260809 01:58:25.254439 24990 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:25.248852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:43875 (local address 127.14.175.254:32933)
0809 01:58:25.249113 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:25.249117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:25.249186 (+ 69us) server_negotiation.cc:407] Connection header received
0809 01:58:25.249382 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:25.249386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:25.249445 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:25.249549 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:25.250000 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.250526 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.251297 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.251526 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.251622 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.254308 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:43875: BlockingRecv error: recv got EOF from 127.14.175.193:43875 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":70,"threads_started":1}
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:25.429526 24991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:25.424252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:49851)
0809 01:58:25.424539 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:25.424553 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:25.424651 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:25.424939 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:25.424941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:25.425135 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:25.425235 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.425240 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.425999 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.426001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.426555 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.426562 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.427119 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.427122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.427186 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.427665 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:25.427677 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:25.429411 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":112,"threads_started":1}
W20260809 01:58:25.429661 24990 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:25.424420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:49851 (local address 127.14.175.254:32933)
0809 01:58:25.424560 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:25.424563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:25.424604 (+ 41us) server_negotiation.cc:407] Connection header received
0809 01:58:25.424769 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:25.424772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:25.424830 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:25.424903 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:25.425354 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.425906 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.426658 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.426901 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.427015 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.429540 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:49851: BlockingRecv error: recv got EOF from 127.14.175.194:49851 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:25 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:25.626106 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:25.620950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:53995)
0809 01:58:25.621257 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:25.621271 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:25.621371 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:25.621604 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:25.621606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:25.621788 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:25.621883 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.621887 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.622624 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.622626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.623278 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:25.623288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.623715 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.623717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:25.623777 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.624248 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:25.624258 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:25.625973 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":105,"threads_started":1}
W20260809 01:58:25.626222 24990 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:25.621007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:53995 (local address 127.14.175.254:32933)
0809 01:58:25.621177 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:25.621182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:25.621346 (+ 164us) server_negotiation.cc:407] Connection header received
0809 01:58:25.621450 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:25.621452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:25.621500 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:25.621566 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:25.621984 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.622530 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.623393 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:25.623617 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:25.623701 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:25.626106 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:53995: BlockingRecv error: recv got EOF from 127.14.175.195:53995 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:26.277287 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:26.255284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:35735)
0809 01:58:26.255586 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:26.255600 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:26.255714 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:26.256036 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:26.256039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:26.256320 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:26.256451 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.256460 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.257264 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.257266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.257821 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.257828 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.258245 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.258248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.258321 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.275081 (+ 16760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:26.275094 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:26.277166 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":122,"threads_started":1}
W20260809 01:58:26.277588 24994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:26.255349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35735 (local address 127.14.175.254:32933)
0809 01:58:26.255652 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:26.255657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:26.255672 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:26.255827 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:26.255833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:26.255894 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:26.255987 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:26.256586 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.257157 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.257925 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.258149 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.258224 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.277305 (+ 19081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:35735: BlockingRecv error: recv got EOF from 127.14.175.193:35735 (error 108)
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":96,"threads_started":1}
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:26.436210 24995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:26.430445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:49179)
0809 01:58:26.430803 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:26.430821 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:26.431023 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:26.431315 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:26.431318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:26.431540 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:26.431636 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.431643 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.432433 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.432438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.433039 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.433048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.433532 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.433535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.433637 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.434147 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:26.434158 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:26.436094 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":94,"threads_started":1}
W20260809 01:58:26.436355 24994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:26.430589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:49179 (local address 127.14.175.254:32933)
0809 01:58:26.430782 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:26.430787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:26.430915 (+ 128us) server_negotiation.cc:407] Connection header received
0809 01:58:26.431137 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:26.431140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:26.431196 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:26.431290 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:26.431761 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.432312 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.433173 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.433406 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.433519 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.436237 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:49179: BlockingRecv error: recv got EOF from 127.14.175.194:49179 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:26 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.195@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:26.632472 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:26.626904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.195:52983)
0809 01:58:26.627309 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:26.627321 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:26.627424 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:26.627665 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:26.627667 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:26.627850 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:26.627944 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.627949 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.628685 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.628687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.629259 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:26.629267 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.629808 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.629811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:26.629874 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.630366 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:26.630376 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:26.632285 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":118,"threads_started":1}
W20260809 01:58:26.632557 24994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:26.627050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:52983 (local address 127.14.175.254:32933)
0809 01:58:26.627199 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:26.627203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:26.627397 (+ 194us) server_negotiation.cc:407] Connection header received
0809 01:58:26.627505 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:26.627507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:26.627556 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:26.627625 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:26.628055 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.628590 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.629371 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:26.629706 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:26.629786 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:26.632424 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.195:52983: BlockingRecv error: recv got EOF from 127.14.175.195:52983 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 01:58:27 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:27 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.193@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:27.284585 24999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:27.278387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.193:54089)
0809 01:58:27.278658 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:27.278672 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:27.278755 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:27.279221 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:27.279223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:27.279439 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:27.279554 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:27.279561 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.280378 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.280381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:27.280990 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:27.280998 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.281586 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.281590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:27.281681 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:27.282178 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:27.282189 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:27.284464 (+ 2275us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
W20260809 01:58:27.284835 25000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:27.278476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:54089 (local address 127.14.175.254:32933)
0809 01:58:27.278729 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:27.278733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:27.278748 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:58:27.279040 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:27.279043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:27.279090 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:27.279172 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:27.279675 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.280275 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.281173 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.281449 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.281570 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:27.284597 (+ 3027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.193:54089: BlockingRecv error: recv got EOF from 127.14.175.193:54089 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
Aug 09 01:58:27 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 01:58:27 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.175.194@KRBTEST.COM for oryx/127.14.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 01:58:27.442221 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:27.437136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32933 (local address 127.14.175.194:56789)
0809 01:58:27.437394 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:27.437407 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:27.437521 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:27.437750 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:27.437752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:27.437932 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:27.438026 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:27.438031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.438736 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.438739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:27.439360 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:27.439369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.439772 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.439774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:27.439834 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:27.440281 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:27.440292 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:27.442114 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.175.254:32933: Server oryx/127.14.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
W20260809 01:58:27.442410 25000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:27.437241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:56789 (local address 127.14.175.254:32933)
0809 01:58:27.437406 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:27.437412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:27.437456 (+ 44us) server_negotiation.cc:407] Connection header received
0809 01:58:27.437599 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:27.437602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:27.437644 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:27.437715 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:27.438122 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.438642 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.439462 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.439676 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.439756 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:27.442245 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.175.194:56789: BlockingRecv error: recv got EOF from 127.14.175.194:56789 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 01:58:27.533391 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24473
I20260809 01:58:27.541247 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24639
I20260809 01:58:27.547415 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24788
I20260809 01:58:27.554025 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 24395
2026-08-09T01:58:27Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18040 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T01:58:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:27Z Disabled control of system clock
I20260809 01:58:27.587177 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43285
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:45697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:43285
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 01:58:27.695557 25006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:27.695848 25006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:27.695883 25006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:27.699833 25006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:27.699888 25006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:27.699903 25006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:27.699920 25006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:27.699935 25006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:27.704684 25006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:43285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:27.705716 25006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:27.707036 25006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:27.715233 25012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:27.715233 25011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:27.715628 25006 server_base.cc:1034] running on GCE node
W20260809 01:58:27.715337 25014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:27.716470 25006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:27.717551 25006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:27.718744 25006 hybrid_clock.cc:648] HybridClock initialized: now 1786240707718726 us; error 31 us; skew 500 ppm
I20260809 01:58:27.720713 25006 webserver.cc:460] Webserver started at http://127.14.175.254:36663/ using document root <none> and password file <none>
I20260809 01:58:27.721336 25006 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:27.721434 25006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:27.721673 25006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:27.723752 25006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "66d3fa9d26764e4fb4a03ef2b3080468"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "a070673a7029c032f5051d4c82572f35"
server_key_iv: "baf5468deaafc0bb1bba591e541edab1"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.724334 25006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "66d3fa9d26764e4fb4a03ef2b3080468"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "a070673a7029c032f5051d4c82572f35"
server_key_iv: "baf5468deaafc0bb1bba591e541edab1"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.727900 25006 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:58:27.730178 25021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:27.731359 25006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:27.731492 25006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "66d3fa9d26764e4fb4a03ef2b3080468"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "a070673a7029c032f5051d4c82572f35"
server_key_iv: "baf5468deaafc0bb1bba591e541edab1"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.731597 25006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:27.756770 25006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:27.757422 25006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:27.757617 25006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:27.764458 25006 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:43285
I20260809 01:58:27.764472 25076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:43285 every 8 connection(s)
I20260809 01:58:27.765316 25006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:27.768440 25077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:27.772866 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25006
I20260809 01:58:27.772984 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:27.773312 15039 external_mini_cluster.cc:1428] Setting key 8a5a4d105a03ea18df2f3766a87d051f
I20260809 01:58:27.774422 25077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: Bootstrap starting.
I20260809 01:58:27.776695 25077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:27.777411 25077 log.cc:824] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:27.779295 25077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: No bootstrap required, opened a new log
I20260809 01:58:27.782243 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:27.774737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41362 (local address 127.14.175.254:43285)
0809 01:58:27.775385 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:27.775400 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:27.775434 (+ 34us) server_negotiation.cc:407] Connection header received
0809 01:58:27.776037 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:27.776052 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:27.776432 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:27.776746 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:27.777163 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.778193 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.779156 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:27.779672 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:27.779842 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:27.780686 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:27.780691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:27.780703 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:27.781054 (+ 351us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:27.781106 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:27.781125 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:27.781226 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:27.781363 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 01:58:27.781596 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":159,"threads_started":1}
I20260809 01:58:27.782773 25077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } }
I20260809 01:58:27.783032 25077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:27.783149 25077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3fa9d26764e4fb4a03ef2b3080468, State: Initialized, Role: FOLLOWER
I20260809 01:58:27.783618 25077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } }
I20260809 01:58:27.783776 25077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:27.783838 25077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:27.783927 25077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:27.784840 25077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } }
I20260809 01:58:27.785156 25077 leader_election.cc:302] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66d3fa9d26764e4fb4a03ef2b3080468; no voters:
I20260809 01:58:27.785430 25077 leader_election.cc:288] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:27.785564 25082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:27.785799 25082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3fa9d26764e4fb4a03ef2b3080468, State: Running, Role: LEADER
I20260809 01:58:27.786158 25082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } }
I20260809 01:58:27.786599 25077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:27.788081 25083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } } }
I20260809 01:58:27.788204 25083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:27.788532 25084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66d3fa9d26764e4fb4a03ef2b3080468. Latest consensus state: current_term: 1 leader_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66d3fa9d26764e4fb4a03ef2b3080468" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43285 } } }
I20260809 01:58:27.788656 25084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468 [sys.catalog]: This master's current role is: LEADER
W20260809 01:58:27.791735 25099 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:27.791822 25099 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:27.791900 25094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:27.792600 25094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:27.797454 25094 catalog_manager.cc:1347] Generated new cluster ID: 22e65af9d5ad48aea0fec6ace4eb5f1f
I20260809 01:58:27.797518 25094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:27.813807 25094 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:27.814673 25094 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:27.821200 25094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66d3fa9d26764e4fb4a03ef2b3080468: Generated new TSK 0
I20260809 01:58:27.821838 25094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:58:27.827028 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--builtin_ntp_servers=127.14.175.212:45697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 01:58:27.935495 25104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:27.935760 25104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:27.935837 25104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:27.939858 25104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:27.939932 25104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:27.940013 25104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:27.944521 25104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:27.945529 25104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:27.946858 25104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:27.956168 25112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:27.956225 25110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:27.956183 25109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:27.956401 25104 server_base.cc:1034] running on GCE node
I20260809 01:58:27.956862 25104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:27.957476 25104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:27.958680 25104 hybrid_clock.cc:648] HybridClock initialized: now 1786240707958658 us; error 43 us; skew 500 ppm
I20260809 01:58:27.960579 25104 webserver.cc:460] Webserver started at http://127.14.175.193:35437/ using document root <none> and password file <none>
I20260809 01:58:27.961135 25104 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:27.961227 25104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:27.961454 25104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:27.963536 25104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "a15c43dd38454a78b7fd7980840ee9ce"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "0366538f8f13b7da1180f63720f7a4ae"
server_key_iv: "0986a852e8e1101ad7e2487f040f804e"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.964118 25104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "a15c43dd38454a78b7fd7980840ee9ce"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "0366538f8f13b7da1180f63720f7a4ae"
server_key_iv: "0986a852e8e1101ad7e2487f040f804e"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.967661 25104 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:58:27.970115 25119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:27.971344 25104 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:27.971479 25104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "a15c43dd38454a78b7fd7980840ee9ce"
format_stamp: "Formatted at 2026-08-09 01:58:27 on dist-test-slave-2w3w"
server_key: "0366538f8f13b7da1180f63720f7a4ae"
server_key_iv: "0986a852e8e1101ad7e2487f040f804e"
server_key_version: "encryptionkey@0"
I20260809 01:58:27.971594 25104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:27.987991 25104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:27.988651 25104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:27.988854 25104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:27.989415 25104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:27.990322 25104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:27.990392 25104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:27.990463 25104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:27.990515 25104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:27.999495 25104 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:38255
I20260809 01:58:27.999573 25245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:38255 every 8 connection(s)
I20260809 01:58:28.000448 25104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:28.003924 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25104
I20260809 01:58:28.004060 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:28.004361 15039 external_mini_cluster.cc:1428] Setting key 294c79a5a5399df03baadc1d0add8e84
I20260809 01:58:28.006407 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--builtin_ntp_servers=127.14.175.212:45697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 01:58:28.010275 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.002414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:45285 (local address 127.14.175.254:43285)
0809 01:58:28.002585 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.002590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.003565 (+ 975us) server_negotiation.cc:407] Connection header received
0809 01:58:28.005121 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.005124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.005179 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.005267 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.006234 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.007046 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.008233 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.008463 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.008583 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.009774 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:28.009784 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:28.009787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:28.009798 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:28.009819 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:28.009827 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:28.009906 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:28.010071 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 01:58:28.010134 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 01:58:28.011210 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.002680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43285 (local address 127.14.175.193:45285)
0809 01:58:28.003416 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:28.003456 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:28.004848 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:28.005425 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:28.005431 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:28.005515 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:28.006088 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.006101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.007168 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.007171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.008104 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.008114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.008634 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.008639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.008829 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.009489 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:28.009491 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:28.009544 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:28.009626 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:28.009908 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:28.009921 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:28.009930 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 01:58:28.010069 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 01:58:28.010340 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":139,"threads_started":1}
I20260809 01:58:28.012387 25246 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43285
I20260809 01:58:28.012645 25246 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:28.013345 25246 heartbeater.cc:511] Master 127.14.175.254:43285 requested a full tablet report, sending...
I20260809 01:58:28.014933 25040 ts_manager.cc:194] Registered new tserver with Master: a15c43dd38454a78b7fd7980840ee9ce (127.14.175.193:38255)
I20260809 01:58:28.016120 25040 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.193:45285
W20260809 01:58:28.117039 25249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:28.117268 25249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:28.117303 25249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:28.121429 25249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:28.121474 25249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:28.121553 25249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:28.126276 25249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:28.127247 25249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:28.128568 25249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:28.138259 25254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.138284 25255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.138235 25257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.138448 25249 server_base.cc:1034] running on GCE node
I20260809 01:58:28.138888 25249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:28.139531 25249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:28.140691 25249 hybrid_clock.cc:648] HybridClock initialized: now 1786240708140660 us; error 46 us; skew 500 ppm
I20260809 01:58:28.142354 25249 webserver.cc:460] Webserver started at http://127.14.175.194:45383/ using document root <none> and password file <none>
I20260809 01:58:28.142894 25249 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:28.142998 25249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:28.143245 25249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:28.145159 25249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "eb0bd3acd3d34a858ebbeec45e92ea6a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "5b316adbfa8617f0769fb7143b1bb7af"
server_key_iv: "dea4cddf9b9c93c8bc4af873fa9116c9"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.145706 25249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "eb0bd3acd3d34a858ebbeec45e92ea6a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "5b316adbfa8617f0769fb7143b1bb7af"
server_key_iv: "dea4cddf9b9c93c8bc4af873fa9116c9"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.149170 25249 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 01:58:28.151517 25263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.152665 25249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 01:58:28.152801 25249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "eb0bd3acd3d34a858ebbeec45e92ea6a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "5b316adbfa8617f0769fb7143b1bb7af"
server_key_iv: "dea4cddf9b9c93c8bc4af873fa9116c9"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.152910 25249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:28.169788 25249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:28.170449 25249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:28.170653 25249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:28.171284 25249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:28.172183 25249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:28.172255 25249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.172325 25249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:28.172380 25249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.181453 25249 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38595
I20260809 01:58:28.181480 25390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38595 every 8 connection(s)
I20260809 01:58:28.182307 25249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:28.183513 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25249
I20260809 01:58:28.183627 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:28.183928 15039 external_mini_cluster.cc:1428] Setting key 711b40f1d0ac3dda5cb59d3e11319d85
I20260809 01:58:28.186156 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--builtin_ntp_servers=127.14.175.212:45697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 01:58:28.192917 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.185576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:33717 (local address 127.14.175.254:43285)
0809 01:58:28.185707 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.185711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.185724 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:58:28.187385 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.187387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.187432 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.187547 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.188659 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.189525 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.190658 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.191132 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.191257 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.192323 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:28.192329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:28.192335 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:28.192354 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:28.192382 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:28.192396 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:28.192491 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:28.192630 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 01:58:28.192706 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:58:28.193625 25393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.184546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43285 (local address 127.14.175.194:33717)
0809 01:58:28.185254 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:28.185312 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:28.187178 (+ 1866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:28.187698 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:28.187709 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:28.187842 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:28.188514 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.188528 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.189656 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.189658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.190533 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.190542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.191298 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.191301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.191446 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.192067 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:28.192068 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:28.192106 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:28.192166 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:28.192494 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:28.192501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:28.192505 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 01:58:28.192593 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 01:58:28.192800 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":169,"threads_started":1}
I20260809 01:58:28.195004 25391 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43285
I20260809 01:58:28.195243 25391 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:28.195722 25391 heartbeater.cc:511] Master 127.14.175.254:43285 requested a full tablet report, sending...
I20260809 01:58:28.196748 25040 ts_manager.cc:194] Registered new tserver with Master: eb0bd3acd3d34a858ebbeec45e92ea6a (127.14.175.194:38595)
I20260809 01:58:28.197315 25040 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.194:33717
W20260809 01:58:28.297469 25394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:28.297715 25394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:28.297791 25394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:28.301839 25394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:28.301896 25394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:28.301992 25394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:28.306666 25394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:45697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:28.307711 25394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:28.309067 25394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:28.318531 25402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.318523 25400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.318625 25394 server_base.cc:1034] running on GCE node
W20260809 01:58:28.318590 25399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.319296 25394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:28.319881 25394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:28.321072 25394 hybrid_clock.cc:648] HybridClock initialized: now 1786240708321049 us; error 31 us; skew 500 ppm
I20260809 01:58:28.322927 25394 webserver.cc:460] Webserver started at http://127.14.175.195:43149/ using document root <none> and password file <none>
I20260809 01:58:28.323537 25394 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:28.323598 25394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:28.323755 25394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:28.325726 25394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "716859aa46814f0cb02d28e9d11ec4f2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "32bb658d22fb4f5115742d7cb3ba282a"
server_key_iv: "fb8696aca49b681def9b75a5a978ba56"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.326234 25394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "716859aa46814f0cb02d28e9d11ec4f2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "32bb658d22fb4f5115742d7cb3ba282a"
server_key_iv: "fb8696aca49b681def9b75a5a978ba56"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.329710 25394 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260809 01:58:28.332084 25409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.333189 25394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:28.333331 25394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "716859aa46814f0cb02d28e9d11ec4f2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "32bb658d22fb4f5115742d7cb3ba282a"
server_key_iv: "fb8696aca49b681def9b75a5a978ba56"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.333438 25394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:28.348898 25394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:28.349472 25394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:28.349650 25394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:28.350167 25394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:28.351042 25394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:28.351110 25394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.351171 25394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:28.351214 25394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.359967 25394 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:43143
I20260809 01:58:28.360013 25537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:43143 every 8 connection(s)
I20260809 01:58:28.360778 25394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:28.363382 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25394
I20260809 01:58:28.363497 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:28.363797 15039 external_mini_cluster.cc:1428] Setting key 18914fa708d1657b3f5e075699900200
I20260809 01:58:28.369808 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.362451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:39217 (local address 127.14.175.254:43285)
0809 01:58:28.362579 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.362583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.363622 (+ 1039us) server_negotiation.cc:407] Connection header received
0809 01:58:28.365056 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.365059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.365117 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.365213 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.366320 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.366868 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.368010 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.368233 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.368353 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.369322 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:28.369335 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:28.369338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:28.369356 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:28.369375 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:28.369382 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:28.369458 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:28.369611 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 01:58:28.369667 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 01:58:28.370533 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.362797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43285 (local address 127.14.175.195:39217)
0809 01:58:28.363467 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:28.363519 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:28.364849 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:28.365374 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:28.365383 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:28.365480 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:28.366185 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.366201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.367012 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.367016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.367882 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:28.367891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:28.368385 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:28.368389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:28.368563 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:28.369078 (+ 515us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:28.369079 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:28.369113 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:28.369168 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:28.369459 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:28.369470 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:28.369477 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 01:58:28.369598 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 01:58:28.369887 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":160,"threads_started":1}
I20260809 01:58:28.371551 25538 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43285
I20260809 01:58:28.371783 25538 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:28.372249 25538 heartbeater.cc:511] Master 127.14.175.254:43285 requested a full tablet report, sending...
I20260809 01:58:28.373168 25040 ts_manager.cc:194] Registered new tserver with Master: 716859aa46814f0cb02d28e9d11ec4f2 (127.14.175.195:43143)
I20260809 01:58:28.373751 25040 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.195:39217
I20260809 01:58:28.377444 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 01:58:28.380203 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:28.379246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.14.175.254:43285)
0809 01:58:28.379379 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.379383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.379591 (+ 208us) server_negotiation.cc:407] Connection header received
0809 01:58:28.379717 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.379719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.379757 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.379852 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.380094 (+ 242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49468: BlockingRecv error: recv got EOF from 127.0.0.1:49468 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:58:28.380370 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25104
I20260809 01:58:28.387907 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25249
I20260809 01:58:28.394519 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25394
I20260809 01:58:28.401153 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25006
2026-08-09T01:58:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (844 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T01:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:28Z Disabled control of system clock
I20260809 01:58:28.431939 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37331
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:43719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:37331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 01:58:28.538854 25549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:28.539119 25549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:28.539155 25549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:28.542906 25549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:28.542948 25549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:28.542976 25549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:28.543011 25549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:28.543040 25549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:28.547536 25549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:37331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:28.548399 25549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:28.549599 25549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:28.557574 25554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.557591 25558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.557624 25555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.557891 25549 server_base.cc:1034] running on GCE node
I20260809 01:58:28.558449 25549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:28.559573 25549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:28.560776 25549 hybrid_clock.cc:648] HybridClock initialized: now 1786240708560746 us; error 43 us; skew 500 ppm
I20260809 01:58:28.562458 25549 webserver.cc:460] Webserver started at http://127.14.175.254:40309/ using document root <none> and password file <none>
I20260809 01:58:28.563071 25549 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:28.563167 25549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:28.563408 25549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:28.565367 25549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "4a2caec7e3c3462abef4c4431ef66f15"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "6d06c3a5291b9e37d3cc66e73cc1efae"
server_key_iv: "260b68bb95b72d452659600db555eb0f"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.565932 25549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "4a2caec7e3c3462abef4c4431ef66f15"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "6d06c3a5291b9e37d3cc66e73cc1efae"
server_key_iv: "260b68bb95b72d452659600db555eb0f"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.569502 25549 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 01:58:28.571839 25564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.572953 25549 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:28.573097 25549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "4a2caec7e3c3462abef4c4431ef66f15"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "6d06c3a5291b9e37d3cc66e73cc1efae"
server_key_iv: "260b68bb95b72d452659600db555eb0f"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.573205 25549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:28.577690 25549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:28.578250 25549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:28.578431 25549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:28.585403 25549 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:37331
I20260809 01:58:28.585424 25622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:37331 every 8 connection(s)
I20260809 01:58:28.586221 25549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:28.587414 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25549
I20260809 01:58:28.587558 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:28.587900 15039 external_mini_cluster.cc:1428] Setting key 472ce98f0331b41df9e64ccd16ebc584
I20260809 01:58:28.589735 25623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:28.593734 25626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.589227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55204 (local address 127.14.175.254:37331)
0809 01:58:28.589890 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.589908 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.589948 (+ 40us) server_negotiation.cc:407] Connection header received
0809 01:58:28.590763 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.590802 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.591254 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.591602 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.592304 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:28.592309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:28.592323 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:28.592334 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:28.592404 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:28.592425 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:28.592584 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:28.592648 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 01:58:28.592891 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":115,"threads_started":1}
I20260809 01:58:28.596192 25623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15: Bootstrap starting.
I20260809 01:58:28.598176 25623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:28.598950 25623 log.cc:824] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:28.600629 25623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15: No bootstrap required, opened a new log
I20260809 01:58:28.603823 25623 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } }
I20260809 01:58:28.604020 25623 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:28.604096 25623 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a2caec7e3c3462abef4c4431ef66f15, State: Initialized, Role: FOLLOWER
I20260809 01:58:28.604521 25623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } }
I20260809 01:58:28.604686 25623 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:28.604749 25623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:28.604854 25623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:28.605628 25623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } }
I20260809 01:58:28.605963 25623 leader_election.cc:302] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a2caec7e3c3462abef4c4431ef66f15; no voters:
I20260809 01:58:28.606258 25623 leader_election.cc:288] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:28.606380 25628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:28.606639 25628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [term 1 LEADER]: Becoming Leader. State: Replica: 4a2caec7e3c3462abef4c4431ef66f15, State: Running, Role: LEADER
I20260809 01:58:28.607002 25628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } }
I20260809 01:58:28.607477 25623 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:28.608554 25629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a2caec7e3c3462abef4c4431ef66f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } } }
I20260809 01:58:28.608691 25629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:28.608958 25630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a2caec7e3c3462abef4c4431ef66f15. Latest consensus state: current_term: 1 leader_uuid: "4a2caec7e3c3462abef4c4431ef66f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2caec7e3c3462abef4c4431ef66f15" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37331 } } }
I20260809 01:58:28.609036 25638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:28.609050 25630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:28.611707 25638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:28.616474 25638 catalog_manager.cc:1347] Generated new cluster ID: 664d689ba6f94369b16f18431f3f29af
I20260809 01:58:28.616536 25638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:28.637785 25638 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:28.638106 25638 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:28.649129 25638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a2caec7e3c3462abef4c4431ef66f15: Generated new TSK 0
I20260809 01:58:28.649914 25638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 01:58:28.663278 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--builtin_ntp_servers=127.14.175.212:43719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 01:58:28.770642 25648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:28.770864 25648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:28.770900 25648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:28.774637 25648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:28.774682 25648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:28.774780 25648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:28.780848 25648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:28.782083 25648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:28.783883 25648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:28.793563 25657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.793563 25654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.793592 25655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.793838 25648 server_base.cc:1034] running on GCE node
I20260809 01:58:28.794405 25648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:28.795054 25648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:28.796239 25648 hybrid_clock.cc:648] HybridClock initialized: now 1786240708796228 us; error 28 us; skew 500 ppm
I20260809 01:58:28.797936 25648 webserver.cc:460] Webserver started at http://127.14.175.193:42037/ using document root <none> and password file <none>
I20260809 01:58:28.798494 25648 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:28.798609 25648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:28.798846 25648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:28.800868 25648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "208d409a9a874e84acc5e4df376258e2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "18510ee520ad64e3a5d329e0abc59ae8"
server_key_iv: "86249351e9fc79d4fa42e9cc2a47c20b"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.801432 25648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "208d409a9a874e84acc5e4df376258e2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "18510ee520ad64e3a5d329e0abc59ae8"
server_key_iv: "86249351e9fc79d4fa42e9cc2a47c20b"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.805001 25648 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 01:58:28.807436 25663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.808670 25648 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:28.808810 25648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "208d409a9a874e84acc5e4df376258e2"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "18510ee520ad64e3a5d329e0abc59ae8"
server_key_iv: "86249351e9fc79d4fa42e9cc2a47c20b"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.808955 25648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:28.813380 25648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:28.813903 25648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:28.814049 25648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:28.814504 25648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:28.815404 25648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:28.815450 25648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.815486 25648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:28.815510 25648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:28.824326 25648 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:33811
I20260809 01:58:28.824406 25789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:33811 every 8 connection(s)
I20260809 01:58:28.825191 25648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:28.829931 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25648
I20260809 01:58:28.830063 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:28.830454 15039 external_mini_cluster.cc:1428] Setting key 327b24cf0a874ec98ff903ca81efb0c2
I20260809 01:58:28.831492 25626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.826948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35523 (local address 127.14.175.254:37331)
0809 01:58:28.827102 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:28.827106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:28.828081 (+ 975us) server_negotiation.cc:407] Connection header received
0809 01:58:28.829388 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:28.829392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:28.829446 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:28.829557 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:28.831034 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:28.831039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:28.831041 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:28.831054 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:28.831076 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:28.831085 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:28.831174 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:28.831359 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 01:58:28.831394 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 01:58:28.832428 25792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:28.827308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37331 (local address 127.14.175.193:35523)
0809 01:58:28.827941 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:28.827978 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:28.829161 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:28.829769 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:28.829780 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:28.829901 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:28.830693 (+ 792us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:28.830695 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:28.830732 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:28.830822 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:28.831201 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:28.831211 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:28.831217 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 01:58:28.831385 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 01:58:28.831602 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260809 01:58:28.832569 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--builtin_ntp_servers=127.14.175.212:43719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 01:58:28.833570 25790 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37331
I20260809 01:58:28.833824 25790 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:28.834244 25790 heartbeater.cc:511] Master 127.14.175.254:37331 requested a full tablet report, sending...
I20260809 01:58:28.835738 25583 ts_manager.cc:194] Registered new tserver with Master: 208d409a9a874e84acc5e4df376258e2 (127.14.175.193:33811)
W20260809 01:58:28.970420 25793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:28.970682 25793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:28.970721 25793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:28.974740 25793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:28.974821 25793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:28.974877 25793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:28.979689 25793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:28.980677 25793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:28.981980 25793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:28.991330 25803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.991330 25800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:28.991374 25798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:28.991964 25793 server_base.cc:1034] running on GCE node
I20260809 01:58:28.992370 25793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:28.992969 25793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:28.994140 25793 hybrid_clock.cc:648] HybridClock initialized: now 1786240708994127 us; error 23 us; skew 500 ppm
I20260809 01:58:28.996065 25793 webserver.cc:460] Webserver started at http://127.14.175.194:34829/ using document root <none> and password file <none>
I20260809 01:58:28.996630 25793 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:28.996694 25793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:28.996904 25793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:28.998947 25793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "26cd961cd7c74ff9a856d7301a5c295a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "09777889eab4b2dd087f458bbbfa65cb"
server_key_iv: "ae37ec6669a09aa21863493cc504b219"
server_key_version: "encryptionkey@0"
I20260809 01:58:28.999605 25793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "26cd961cd7c74ff9a856d7301a5c295a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "09777889eab4b2dd087f458bbbfa65cb"
server_key_iv: "ae37ec6669a09aa21863493cc504b219"
server_key_version: "encryptionkey@0"
I20260809 01:58:29.003311 25793 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 01:58:29.005784 25809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.007005 25793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:29.007139 25793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "26cd961cd7c74ff9a856d7301a5c295a"
format_stamp: "Formatted at 2026-08-09 01:58:28 on dist-test-slave-2w3w"
server_key: "09777889eab4b2dd087f458bbbfa65cb"
server_key_iv: "ae37ec6669a09aa21863493cc504b219"
server_key_version: "encryptionkey@0"
I20260809 01:58:29.007272 25793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:29.012029 25793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:29.012743 25793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:29.012923 25793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:29.013499 25793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:29.014358 25793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:29.014431 25793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.014495 25793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:29.014559 25793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.023651 25793 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:39129
I20260809 01:58:29.023672 25932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:39129 every 8 connection(s)
I20260809 01:58:29.024461 25793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:29.030026 25626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:29.026172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:53525 (local address 127.14.175.254:37331)
0809 01:58:29.026334 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:29.026339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:29.027403 (+ 1064us) server_negotiation.cc:407] Connection header received
0809 01:58:29.028631 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:29.028633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:29.028670 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:29.028744 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:29.029683 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:29.029686 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:29.029688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:29.029698 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:29.029717 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:29.029725 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:29.029797 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:29.029887 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 01:58:29.029923 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 01:58:29.030835 25936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:29.026591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37331 (local address 127.14.175.194:53525)
0809 01:58:29.027266 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:29.027305 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:29.028438 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:29.028860 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:29.028866 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:29.028946 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:29.029434 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:29.029435 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:29.029472 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:29.029551 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:29.029782 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:29.029786 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:29.029789 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 01:58:29.029899 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 01:58:29.030095 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":102,"threads_started":1}
I20260809 01:58:29.031634 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25793
I20260809 01:58:29.031785 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:29.032068 15039 external_mini_cluster.cc:1428] Setting key 235d52a3c09e98f722556fa191d04fe1
I20260809 01:58:29.032107 25934 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37331
I20260809 01:58:29.032337 25934 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:29.032832 25934 heartbeater.cc:511] Master 127.14.175.254:37331 requested a full tablet report, sending...
I20260809 01:58:29.033888 25583 ts_manager.cc:194] Registered new tserver with Master: 26cd961cd7c74ff9a856d7301a5c295a (127.14.175.194:39129)
I20260809 01:58:29.034068 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--builtin_ntp_servers=127.14.175.212:43719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 01:58:29.144483 25937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:29.144740 25937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:29.144815 25937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:29.148765 25937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:29.148839 25937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:29.148921 25937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:29.153640 25937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:29.154603 25937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:29.155956 25937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:29.166110 25943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:29.166124 25945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:29.166214 25937 server_base.cc:1034] running on GCE node
W20260809 01:58:29.166123 25942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:29.166765 25937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:29.167426 25937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:29.168622 25937 hybrid_clock.cc:648] HybridClock initialized: now 1786240709168609 us; error 27 us; skew 500 ppm
I20260809 01:58:29.170403 25937 webserver.cc:460] Webserver started at http://127.14.175.195:35511/ using document root <none> and password file <none>
I20260809 01:58:29.171048 25937 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:29.171150 25937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:29.171360 25937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:29.173440 25937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "f1b1ebf17784487e9ab5ac5fcb1e84af"
format_stamp: "Formatted at 2026-08-09 01:58:29 on dist-test-slave-2w3w"
server_key: "b25853bfe829949e8e7012920c1c9c99"
server_key_iv: "6c44ba18ba09af0904a82068acd0c756"
server_key_version: "encryptionkey@0"
I20260809 01:58:29.174041 25937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "f1b1ebf17784487e9ab5ac5fcb1e84af"
format_stamp: "Formatted at 2026-08-09 01:58:29 on dist-test-slave-2w3w"
server_key: "b25853bfe829949e8e7012920c1c9c99"
server_key_iv: "6c44ba18ba09af0904a82068acd0c756"
server_key_version: "encryptionkey@0"
I20260809 01:58:29.177876 25937 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 01:58:29.180578 25952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.181823 25937 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:29.181958 25937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "f1b1ebf17784487e9ab5ac5fcb1e84af"
format_stamp: "Formatted at 2026-08-09 01:58:29 on dist-test-slave-2w3w"
server_key: "b25853bfe829949e8e7012920c1c9c99"
server_key_iv: "6c44ba18ba09af0904a82068acd0c756"
server_key_version: "encryptionkey@0"
I20260809 01:58:29.182080 25937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:29.186653 25937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:29.187361 25937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:29.187552 25937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:29.188135 25937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:29.189025 25937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:29.189098 25937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.189167 25937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:29.189209 25937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:29.198105 25937 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:42169
I20260809 01:58:29.198149 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:42169 every 8 connection(s)
I20260809 01:58:29.199018 25937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:29.200457 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 25937
I20260809 01:58:29.200582 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:29.200917 15039 external_mini_cluster.cc:1428] Setting key 98727995c203beb4a45a38b82636b6b3
I20260809 01:58:29.205237 25626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:29.200773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:59835 (local address 127.14.175.254:37331)
0809 01:58:29.200934 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:29.200946 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:29.202163 (+ 1217us) server_negotiation.cc:407] Connection header received
0809 01:58:29.203756 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:29.203758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:29.203794 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:29.203861 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:29.204911 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:29.204914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:29.204915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 01:58:29.204924 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:29.204940 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 01:58:29.204946 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:29.205012 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:29.205104 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 01:58:29.205138 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 01:58:29.206061 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:29.201253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37331 (local address 127.14.175.195:59835)
0809 01:58:29.201997 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:29.202049 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:29.203551 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:29.203991 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:29.203996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:29.204077 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:29.204679 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 01:58:29.204680 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:29.204721 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 01:58:29.204787 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:29.205001 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:29.205005 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:29.205008 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 01:58:29.205122 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 01:58:29.205339 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260809 01:58:29.207186 26078 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37331
I20260809 01:58:29.207412 26078 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:29.207859 26078 heartbeater.cc:511] Master 127.14.175.254:37331 requested a full tablet report, sending...
I20260809 01:58:29.208974 25583 ts_manager.cc:194] Registered new tserver with Master: f1b1ebf17784487e9ab5ac5fcb1e84af (127.14.175.195:42169)
I20260809 01:58:29.214749 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 01:58:29.217437 25626 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 01:58:29.216717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55206 (local address 127.14.175.254:37331)
0809 01:58:29.216834 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:29.216838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:29.217002 (+ 164us) server_negotiation.cc:407] Connection header received
0809 01:58:29.217095 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:29.217097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:29.217126 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:29.217189 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:29.217347 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55206: BlockingRecv error: recv got EOF from 127.0.0.1:55206 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 01:58:29.217631 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25648
I20260809 01:58:29.228353 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25793
I20260809 01:58:29.235805 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25937
I20260809 01:58:29.242733 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 25549
2026-08-09T01:58:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (840 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:58:29 dist-test-slave-2w3w krb5kdc[26089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:58:29 dist-test-slave-2w3w krb5kdc[26089](info): set up 2 sockets
Aug 09 01:58:29 dist-test-slave-2w3w krb5kdc[26089](info): commencing operation
krb5kdc: starting...
W20260809 01:58:30.309911 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:30 dist-test-slave-2w3w krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:58:30.434952 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35941
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:35941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:30.542694 26102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:30.543001 26102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:30.543088 26102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:30.546995 26102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:58:30.547077 26102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:30.547117 26102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:30.547154 26102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:58:30.547183 26102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:58:30.552146 26102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:35941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:30.553099 26102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:30.554064 26102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:30.562281 26110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:30.562337 26109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:30.562378 26112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:30.562669 26102 server_base.cc:1034] running on GCE node
I20260809 01:58:30.563277 26102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:30.564373 26102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:30.565541 26102 hybrid_clock.cc:648] HybridClock initialized: now 1786240710565520 us; error 32 us; skew 500 ppm
Aug 09 01:58:30 dist-test-slave-2w3w krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240710, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:30.568250 26102 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:58:30.569022 26102 webserver.cc:460] Webserver started at http://127.14.175.254:42005/ using document root <none> and password file <none>
I20260809 01:58:30.569504 26102 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:30.569559 26102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:30.569713 26102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:30.571697 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "857bf822f7cc41119ab11c3db19f3aa3"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "1cfdc833051baca78234fd9ebf963074"
server_key_iv: "4aad124f8dcfe498d9d07400c1e32b4a"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.572220 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "857bf822f7cc41119ab11c3db19f3aa3"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "1cfdc833051baca78234fd9ebf963074"
server_key_iv: "4aad124f8dcfe498d9d07400c1e32b4a"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.575759 26102 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:58:30.577982 26119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:30.579174 26102 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:30.579289 26102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "857bf822f7cc41119ab11c3db19f3aa3"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "1cfdc833051baca78234fd9ebf963074"
server_key_iv: "4aad124f8dcfe498d9d07400c1e32b4a"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.579371 26102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:30.590745 26102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:30.593567 26102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:30.593746 26102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:30.600911 26102 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:35941
I20260809 01:58:30.601274 26176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:35941 every 8 connection(s)
I20260809 01:58:30.601853 26102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:58:30.604586 26177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:30.609841 26177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: Bootstrap starting.
I20260809 01:58:30.611541 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 26102
I20260809 01:58:30.611675 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:58:30.611992 15039 external_mini_cluster.cc:1428] Setting key 36d7e2192f31868da81ed7b495bc1a5e
I20260809 01:58:30.612568 26177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:30.613502 26177 log.cc:824] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:30.615401 26177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: No bootstrap required, opened a new log
I20260809 01:58:30.618700 26177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } }
I20260809 01:58:30.618927 26177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:30.619004 26177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 857bf822f7cc41119ab11c3db19f3aa3, State: Initialized, Role: FOLLOWER
I20260809 01:58:30.619477 26177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } }
I20260809 01:58:30.619629 26177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:58:30.619717 26177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:58:30.619819 26177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 01:58:30 dist-test-slave-2w3w krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:58:30.620718 26177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } }
I20260809 01:58:30.621066 26177 leader_election.cc:302] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 857bf822f7cc41119ab11c3db19f3aa3; no voters:
I20260809 01:58:30.621395 26177 leader_election.cc:288] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:58:30.621461 26182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:30.621678 26182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [term 1 LEADER]: Becoming Leader. State: Replica: 857bf822f7cc41119ab11c3db19f3aa3, State: Running, Role: LEADER
I20260809 01:58:30.622085 26182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } }
I20260809 01:58:30.622668 26177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:58:30.623400 26182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 857bf822f7cc41119ab11c3db19f3aa3. Latest consensus state: current_term: 1 leader_uuid: "857bf822f7cc41119ab11c3db19f3aa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } } }
I20260809 01:58:30.623546 26182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:30.624444 26183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "857bf822f7cc41119ab11c3db19f3aa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857bf822f7cc41119ab11c3db19f3aa3" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35941 } } }
I20260809 01:58:30.624559 26183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3 [sys.catalog]: This master's current role is: LEADER
I20260809 01:58:30.627003 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:30.613138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60396 (local address 127.14.175.254:35941)
0809 01:58:30.613611 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:30.613648 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:30.613695 (+ 47us) server_negotiation.cc:407] Connection header received
0809 01:58:30.614351 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:30.614367 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:30.614675 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:30.615035 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:30.615881 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.616859 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.617725 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.618193 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.618370 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:30.621214 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:30.621221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:30.621244 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:30.621270 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:30.623566 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:30.624077 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:30.624083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:30.624090 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:30.624291 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:30.624667 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:30.624670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:30.624672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:30.625180 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:30.625383 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:30.625715 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 01:58:30.626008 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":125,"threads_started":1}
W20260809 01:58:30.627650 26200 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 01:58:30.627730 26200 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 01:58:30.627789 26191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:58:30.628618 26191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:58:30.633670 26191 catalog_manager.cc:1347] Generated new cluster ID: 653c684ba1464da19a0c5b200fb93a39
I20260809 01:58:30.633733 26191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:58:30.669273 26191 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:58:30.670408 26191 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:58:30.674203 26191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: Generated new TSK 0
I20260809 01:58:30.674933 26191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:58:30.709671 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:30.819172 26206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:30.819458 26206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:30.819531 26206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:30.823652 26206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:30.823705 26206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:30.823805 26206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:58:30.829651 26206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:30.830621 26206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:30.831665 26206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 01:58:30.841090 26206 server_base.cc:1034] running on GCE node
W20260809 01:58:30.841341 26214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:30.841341 26212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:30.841282 26211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:30.841943 26206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:30.842510 26206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:30.843696 26206 hybrid_clock.cc:648] HybridClock initialized: now 1786240710843683 us; error 33 us; skew 500 ppm
Aug 09 01:58:30 dist-test-slave-2w3w krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240710, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:30.846488 26206 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:58:30.847333 26206 webserver.cc:460] Webserver started at http://127.14.175.193:38153/ using document root <none> and password file <none>
I20260809 01:58:30.847877 26206 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:30.847966 26206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:30.848184 26206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:30.850072 26206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "f91a439be55b45d09ed9ed7620b8f9e8"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "926bc1f182b705099e6c0c6ecc903228"
server_key_iv: "839528fc51307594f4d68b0fc087ce80"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.850623 26206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "f91a439be55b45d09ed9ed7620b8f9e8"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "926bc1f182b705099e6c0c6ecc903228"
server_key_iv: "839528fc51307594f4d68b0fc087ce80"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.854131 26206 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 01:58:30.856498 26221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:30.857662 26206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 01:58:30.857795 26206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "f91a439be55b45d09ed9ed7620b8f9e8"
format_stamp: "Formatted at 2026-08-09 01:58:30 on dist-test-slave-2w3w"
server_key: "926bc1f182b705099e6c0c6ecc903228"
server_key_iv: "839528fc51307594f4d68b0fc087ce80"
server_key_version: "encryptionkey@0"
I20260809 01:58:30.857903 26206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:30.889098 26206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:30.892517 26206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:30.892727 26206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:30.893373 26206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:30.894188 26206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:30.894259 26206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:30.894330 26206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:30.894377 26206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:30.903426 26206 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:42261
I20260809 01:58:30.903451 26344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:42261 every 8 connection(s)
I20260809 01:58:30.904284 26206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:58:30.906659 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 26206
I20260809 01:58:30.906783 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:58:30.907155 15039 external_mini_cluster.cc:1428] Setting key b841ebdba89d2f23b4462644e6ba1802
Aug 09 01:58:30 dist-test-slave-2w3w krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240710, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 01:58:30.919121 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:30.906005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:60445 (local address 127.14.175.254:35941)
0809 01:58:30.906150 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:30.906154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:30.907146 (+ 992us) server_negotiation.cc:407] Connection header received
0809 01:58:30.908598 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:30.908602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:30.908655 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:30.908734 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:30.910344 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.910926 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.912104 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.912347 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.912459 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:30.915348 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:30.915351 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:30.915353 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:30.915377 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:30.916836 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:30.917510 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:30.917513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:30.917515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:30.917594 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:30.918018 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:30.918021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:30.918023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:30.918214 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:30.918304 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:30.918808 (+ 504us) server_negotiation.cc:299] Negotiation successful
0809 01:58:30.918951 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 01:58:30.920017 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:30.906366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35941 (local address 127.14.175.193:60445)
0809 01:58:30.906927 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:30.907024 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:30.908399 (+ 1375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:30.908934 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:30.908943 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:30.909473 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:30.910172 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:30.910193 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.911078 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.911081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:30.911976 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:30.911986 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:30.912497 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:30.912501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:30.912668 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:30.913254 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:30.913270 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:30.915148 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:30.916969 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:30.916976 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:30.916993 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:30.917396 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:30.917694 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:30.917699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:30.917704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:30.917904 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:30.918328 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:30.918332 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:30.918552 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 01:58:30.918748 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 01:58:30.919092 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 01:58:30.921430 26346 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35941
I20260809 01:58:30.921672 26346 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:30.922183 26346 heartbeater.cc:511] Master 127.14.175.254:35941 requested a full tablet report, sending...
I20260809 01:58:30.923867 26137 ts_manager.cc:194] Registered new tserver with Master: f91a439be55b45d09ed9ed7620b8f9e8 (127.14.175.193:42261)
I20260809 01:58:30.925020 26137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:60445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:58:30.937656 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:31.048560 26352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:31.048835 26352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:31.048908 26352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:31.054152 26352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:31.054229 26352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:31.054318 26352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:58:31.059484 26352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:31.060426 26352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:31.061416 26352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:31.070585 26358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:31.070601 26357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:31.070763 26352 server_base.cc:1034] running on GCE node
W20260809 01:58:31.070650 26360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:31.071328 26352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:31.071934 26352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:31.073122 26352 hybrid_clock.cc:648] HybridClock initialized: now 1786240711073110 us; error 23 us; skew 500 ppm
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240711, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:31.075933 26352 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:58:31.076826 26352 webserver.cc:460] Webserver started at http://127.14.175.194:34651/ using document root <none> and password file <none>
I20260809 01:58:31.077355 26352 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:31.077450 26352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:31.077685 26352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:31.079686 26352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "7904c15063ab450aa08449f04f567414"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "ab026b16d07e822636c045628d49c48a"
server_key_iv: "b2b16cade5b0594d6f14f042d1927b8e"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.080247 26352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "7904c15063ab450aa08449f04f567414"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "ab026b16d07e822636c045628d49c48a"
server_key_iv: "b2b16cade5b0594d6f14f042d1927b8e"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.083999 26352 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 01:58:31.086287 26367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.087467 26352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:31.087607 26352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "7904c15063ab450aa08449f04f567414"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "ab026b16d07e822636c045628d49c48a"
server_key_iv: "b2b16cade5b0594d6f14f042d1927b8e"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.087714 26352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:31.119328 26352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:31.122207 26352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:31.122421 26352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:31.123138 26352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:31.124089 26352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:31.124158 26352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.124228 26352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:31.124274 26352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.132853 26352 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44133
I20260809 01:58:31.132906 26490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44133 every 8 connection(s)
I20260809 01:58:31.133774 26352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:58:31.134404 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 26352
I20260809 01:58:31.134523 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:58:31.134863 15039 external_mini_cluster.cc:1428] Setting key 8128413cfa54a80c1cea6f48a763eea0
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240711, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 01:58:31.149420 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.135777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:38173 (local address 127.14.175.254:35941)
0809 01:58:31.135938 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.135943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.136893 (+ 950us) server_negotiation.cc:407] Connection header received
0809 01:58:31.138278 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.138285 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.138353 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.138469 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:31.140148 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.141111 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.142233 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.142663 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.142817 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.145647 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:31.145652 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:31.145656 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:31.145695 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:31.147591 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.148048 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.148051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.148052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.148133 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.148449 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.148452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.148453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.148641 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:31.148726 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.149176 (+ 450us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.149291 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
I20260809 01:58:31.150290 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.136234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35941 (local address 127.14.175.194:38173)
0809 01:58:31.136726 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.136779 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.138059 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.138692 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.138703 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.139284 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:31.139968 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.139992 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.141241 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.141244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.142108 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.142116 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.142845 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.142848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.143061 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.143726 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:31.143741 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:31.145459 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:31.147699 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:31.147704 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:31.147715 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:31.147956 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:31.148216 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:31.148218 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:31.148219 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:31.148345 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:31.148740 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:31.148744 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:31.148959 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.149115 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.149351 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":154,"threads_started":1}
I20260809 01:58:31.151465 26492 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35941
I20260809 01:58:31.151719 26492 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:31.152318 26492 heartbeater.cc:511] Master 127.14.175.254:35941 requested a full tablet report, sending...
I20260809 01:58:31.153460 26137 ts_manager.cc:194] Registered new tserver with Master: 7904c15063ab450aa08449f04f567414 (127.14.175.194:44133)
I20260809 01:58:31.154022 26137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:38173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:58:31.168161 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:58:31.288156 26499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:58:31.288385 26499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:58:31.288460 26499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:58:31.292570 26499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:58:31.292625 26499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:58:31.292723 26499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:58:31.298156 26499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:58:31.299178 26499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:58:31.300179 26499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:58:31.310127 26504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:31.310169 26507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:58:31.310169 26505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:58:31.310565 26499 server_base.cc:1034] running on GCE node
I20260809 01:58:31.310927 26499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:58:31.311551 26499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:58:31.312747 26499 hybrid_clock.cc:648] HybridClock initialized: now 1786240711312720 us; error 47 us; skew 500 ppm
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240711, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:58:31.318589 26499 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:58:31.319584 26499 webserver.cc:460] Webserver started at http://127.14.175.195:33297/ using document root <none> and password file <none>
I20260809 01:58:31.320155 26499 fs_manager.cc:359] Metadata directory not provided
I20260809 01:58:31.320250 26499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:58:31.320492 26499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 01:58:31.322840 26499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "bd5c1b6921464e00bc98b1508083a64a"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "9f9426679971d17b3b691907852ce743"
server_key_iv: "eae362747b456b0e51938b8fe6eb8b3b"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.323581 26499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "bd5c1b6921464e00bc98b1508083a64a"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "9f9426679971d17b3b691907852ce743"
server_key_iv: "eae362747b456b0e51938b8fe6eb8b3b"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.327558 26499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 01:58:31.330024 26515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.331314 26499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 01:58:31.331449 26499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "bd5c1b6921464e00bc98b1508083a64a"
format_stamp: "Formatted at 2026-08-09 01:58:31 on dist-test-slave-2w3w"
server_key: "9f9426679971d17b3b691907852ce743"
server_key_iv: "eae362747b456b0e51938b8fe6eb8b3b"
server_key_version: "encryptionkey@0"
I20260809 01:58:31.331559 26499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:58:31.343492 26499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:58:31.346401 26499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:58:31.346650 26499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:58:31.347452 26499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:58:31.348342 26499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:58:31.348423 26499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.348489 26499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:58:31.348538 26499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:58:31.363539 26499 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:33365
I20260809 01:58:31.363586 26635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:33365 every 8 connection(s)
I20260809 01:58:31.364435 26499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:58:31.365935 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 26499
I20260809 01:58:31.366109 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:58:31.366415 15039 external_mini_cluster.cc:1428] Setting key b5be0c4db35bfb511143332daf06cd69
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240711, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:58:31.378036 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.366171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:41835 (local address 127.14.175.254:35941)
0809 01:58:31.367537 (+ 1366us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.367542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.367559 (+ 17us) server_negotiation.cc:407] Connection header received
0809 01:58:31.369021 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.369024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.369080 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.369180 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:31.370341 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.370879 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.372199 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.372441 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.372566 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.374940 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:31.374943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:31.374945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:31.375015 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:31.376231 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.376705 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.376707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.376709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.376785 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.377120 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.377123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.377124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.377290 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:31.377370 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.377795 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.377919 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1266}
I20260809 01:58:31.378778 26644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.366566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35941 (local address 127.14.175.195:41835)
0809 01:58:31.367088 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.367140 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.368785 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.369368 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.369374 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.369715 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:58:31.370194 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.370207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.371031 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.371043 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.371991 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.372001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.372602 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.372607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.372794 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.373315 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:58:31.373350 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:58:31.374786 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:58:31.376335 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:31.376339 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:31.376349 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:31.376606 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:31.376897 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:58:31.376899 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:58:31.376900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:58:31.377035 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:58:31.377380 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:58:31.377385 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:58:31.377597 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.377747 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.377987 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":153,"threads_started":1}
I20260809 01:58:31.380056 26641 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35941
I20260809 01:58:31.380275 26641 heartbeater.cc:464] Registering TS with master...
I20260809 01:58:31.380791 26641 heartbeater.cc:511] Master 127.14.175.254:35941 requested a full tablet report, sending...
I20260809 01:58:31.381781 26136 ts_manager.cc:194] Registered new tserver with Master: bd5c1b6921464e00bc98b1508083a64a (127.14.175.195:33365)
I20260809 01:58:31.382383 26136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:41835
I20260809 01:58:31.392251 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:58:31.401988 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.394268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60408 (local address 127.14.175.254:35941)
0809 01:58:31.394441 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.394445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.394679 (+ 234us) server_negotiation.cc:407] Connection header received
0809 01:58:31.394789 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.394792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.394859 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.394935 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:58:31.395890 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.396449 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.397251 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.397485 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.397568 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.398884 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:58:31.398887 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:58:31.398889 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:58:31.398911 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:58:31.400301 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.400762 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.400765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.400766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.400877 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:58:31.401124 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:58:31.401126 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:58:31.401127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:58:31.401334 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:58:31.401447 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.401648 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.401798 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 01:58:31.404749 26136 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:58:31.407998 26136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:58:31.422179 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.416237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.14.175.194:44133)
0809 01:58:31.417150 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.417163 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.417186 (+ 23us) server_negotiation.cc:407] Connection header received
0809 01:58:31.417265 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.417273 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.417485 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.417659 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:31.417978 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.419073 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.420775 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.421486 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.421632 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.421772 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.421904 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.422001 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":161,"threads_started":1}
I20260809 01:58:31.422212 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.416054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44133 (local address 127.0.0.1:58112)
0809 01:58:31.416380 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.416419 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.416517 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.417669 (+ 1152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.417678 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.417708 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:31.417852 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.417861 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.419222 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.419225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.420641 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.420651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.421613 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.421616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.421724 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.421760 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.421876 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.421995 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260809 01:58:31.422685 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.416759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33365 (local address 127.0.0.1:59850)
0809 01:58:31.417628 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.417640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.417785 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.418485 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.418490 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.418518 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:31.418611 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.418617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.420002 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.420005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.421062 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.421073 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.422300 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.422303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.422382 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.422401 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.422472 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.422540 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"mutex_wait_us":13,"thread_start_us":97,"threads_started":1}
I20260809 01:58:31.423185 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.416972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59850 (local address 127.14.175.195:33365)
0809 01:58:31.417626 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.417638 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.417722 (+ 84us) server_negotiation.cc:407] Connection header received
0809 01:58:31.417949 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.417954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.418133 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.418288 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:31.418740 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.419849 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.421191 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.421966 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.422121 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.422242 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.422851 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.422945 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":107,"threads_started":1}
I20260809 01:58:31.425668 26421 tablet_service.cc:1467] Processing CreateTablet for tablet ea34906524964654bfb87d42b1f747f5 (DEFAULT_TABLE table=test-table [id=5e4125bc7bbf4ef297b78256df1d70fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:31.425989 26566 tablet_service.cc:1467] Processing CreateTablet for tablet ea34906524964654bfb87d42b1f747f5 (DEFAULT_TABLE table=test-table [id=5e4125bc7bbf4ef297b78256df1d70fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:31.426846 26421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea34906524964654bfb87d42b1f747f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:31.426872 26566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea34906524964654bfb87d42b1f747f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:31.431057 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.416753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42261 (local address 127.0.0.1:42174)
0809 01:58:31.417355 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.417369 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.417458 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.418286 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.418289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.418309 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:31.418401 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.418407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.419649 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.419653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.420828 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.420843 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.422037 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.422044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.422137 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.422160 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.422227 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.422303 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":25,"thread_start_us":105,"threads_started":1}
I20260809 01:58:31.431607 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.417185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.14.175.193:42261)
0809 01:58:31.417835 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.417852 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.417877 (+ 25us) server_negotiation.cc:407] Connection header received
0809 01:58:31.417948 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.417952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.418133 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.418288 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:31.418525 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.419491 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.420945 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.421722 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.421846 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.421963 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.431308 (+ 9345us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.431444 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":90,"threads_started":1}
I20260809 01:58:31.433933 26271 tablet_service.cc:1467] Processing CreateTablet for tablet ea34906524964654bfb87d42b1f747f5 (DEFAULT_TABLE table=test-table [id=5e4125bc7bbf4ef297b78256df1d70fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:58:31.434420 26660 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Bootstrap starting.
I20260809 01:58:31.435029 26271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea34906524964654bfb87d42b1f747f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:58:31.435711 26661 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Bootstrap starting.
I20260809 01:58:31.436709 26660 tablet_bootstrap.cc:654] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:31.438102 26661 tablet_bootstrap.cc:654] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:31.438251 26660 log.cc:824] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:31.438930 26661 log.cc:824] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:31.440402 26660 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: No bootstrap required, opened a new log
I20260809 01:58:31.440582 26661 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: No bootstrap required, opened a new log
I20260809 01:58:31.440598 26660 ts_tablet_manager.cc:1397] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 01:58:31.440769 26661 ts_tablet_manager.cc:1397] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 01:58:31.442473 26664 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: Bootstrap starting.
I20260809 01:58:31.444159 26661 raft_consensus.cc:348] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.444409 26661 raft_consensus.cc:374] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:31.444226 26660 raft_consensus.cc:348] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.444463 26661 raft_consensus.cc:729] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7904c15063ab450aa08449f04f567414, State: Initialized, Role: FOLLOWER
I20260809 01:58:31.444479 26660 raft_consensus.cc:374] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:31.444535 26660 raft_consensus.cc:729] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd5c1b6921464e00bc98b1508083a64a, State: Initialized, Role: FOLLOWER
I20260809 01:58:31.444877 26664 tablet_bootstrap.cc:654] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: Neither blocks nor log segments found. Creating new log.
I20260809 01:58:31.444931 26661 consensus_queue.cc:260] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.444978 26660 consensus_queue.cc:260] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.445598 26492 heartbeater.cc:503] Master 127.14.175.254:35941 was elected leader, sending a full tablet report...
I20260809 01:58:31.445708 26664 log.cc:824] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: Log is configured to *not* fsync() on all Append() calls
I20260809 01:58:31.445835 26641 heartbeater.cc:503] Master 127.14.175.254:35941 was elected leader, sending a full tablet report...
I20260809 01:58:31.445946 26660 ts_tablet_manager.cc:1428] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 01:58:31.446849 26661 ts_tablet_manager.cc:1428] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 01:58:31.448343 26664 tablet_bootstrap.cc:492] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: No bootstrap required, opened a new log
I20260809 01:58:31.448532 26664 ts_tablet_manager.cc:1397] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260809 01:58:31.452093 26664 raft_consensus.cc:348] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.452328 26664 raft_consensus.cc:374] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:58:31.452396 26664 raft_consensus.cc:729] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91a439be55b45d09ed9ed7620b8f9e8, State: Initialized, Role: FOLLOWER
I20260809 01:58:31.452832 26664 consensus_queue.cc:260] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.453462 26346 heartbeater.cc:503] Master 127.14.175.254:35941 was elected leader, sending a full tablet report...
I20260809 01:58:31.453698 26664 ts_tablet_manager.cc:1428] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 01:58:31.531314 26666 raft_consensus.cc:482] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:58:31.531524 26666 raft_consensus.cc:504] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.532945 26666 leader_election.cc:288] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7904c15063ab450aa08449f04f567414 (127.14.175.194:44133), f91a439be55b45d09ed9ed7620b8f9e8 (127.14.175.193:42261)
I20260809 01:58:31.537078 26644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.533180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42261 (local address 127.14.175.195:54129)
0809 01:58:31.533300 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.533317 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.533418 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.533718 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.533721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.533740 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:31.533880 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.533906 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.535023 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.535026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.535915 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.535926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.536644 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.536760 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.536784 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.536873 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.536946 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"spinlock_wait_cycles":1792}
I20260809 01:58:31.537078 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.533356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:54129 (local address 127.14.175.193:42261)
0809 01:58:31.533492 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.533498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.533514 (+ 16us) server_negotiation.cc:407] Connection header received
0809 01:58:31.533574 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.533576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.533617 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.533704 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:31.534046 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.534873 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536064 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.536536 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536644 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.536696 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.536892 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.536964 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 01:58:31.537293 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.533420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:32979 (local address 127.14.175.194:44133)
0809 01:58:31.533571 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.533576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.533737 (+ 161us) server_negotiation.cc:407] Connection header received
0809 01:58:31.533974 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.533980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.534054 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.534134 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:58:31.534468 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.535193 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536277 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.536694 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536833 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.536886 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.537069 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.537141 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 01:58:31.537667 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.533178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44133 (local address 127.14.175.195:32979)
0809 01:58:31.533643 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.533654 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 01:58:31.533840 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:58:31.534162 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:58:31.534165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:58:31.534183 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:58:31.534298 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.534304 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.535306 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.535310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.536153 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:58:31.536162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.536823 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.536827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:58:31.536940 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.536958 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 01:58:31.537054 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 01:58:31.537122 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":43,"spinlock_wait_cycles":31488,"thread_start_us":131,"threads_started":1}
I20260809 01:58:31.537752 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea34906524964654bfb87d42b1f747f5" candidate_uuid: "bd5c1b6921464e00bc98b1508083a64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" is_pre_election: true
I20260809 01:58:31.538086 26294 raft_consensus.cc:2454] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd5c1b6921464e00bc98b1508083a64a in term 0.
I20260809 01:58:31.538280 26443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea34906524964654bfb87d42b1f747f5" candidate_uuid: "bd5c1b6921464e00bc98b1508083a64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7904c15063ab450aa08449f04f567414" is_pre_election: true
I20260809 01:58:31.538551 26443 raft_consensus.cc:2454] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd5c1b6921464e00bc98b1508083a64a in term 0.
I20260809 01:58:31.538600 26519 leader_election.cc:302] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd5c1b6921464e00bc98b1508083a64a, f91a439be55b45d09ed9ed7620b8f9e8; no voters:
I20260809 01:58:31.538929 26666 raft_consensus.cc:2781] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:58:31.539040 26666 raft_consensus.cc:482] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:58:31.539110 26666 raft_consensus.cc:3037] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:31.540155 26666 raft_consensus.cc:504] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.540519 26666 leader_election.cc:288] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [CANDIDATE]: Term 1 election: Requested vote from peers 7904c15063ab450aa08449f04f567414 (127.14.175.194:44133), f91a439be55b45d09ed9ed7620b8f9e8 (127.14.175.193:42261)
I20260809 01:58:31.540843 26443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea34906524964654bfb87d42b1f747f5" candidate_uuid: "bd5c1b6921464e00bc98b1508083a64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7904c15063ab450aa08449f04f567414"
I20260809 01:58:31.540859 26294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea34906524964654bfb87d42b1f747f5" candidate_uuid: "bd5c1b6921464e00bc98b1508083a64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91a439be55b45d09ed9ed7620b8f9e8"
I20260809 01:58:31.540972 26294 raft_consensus.cc:3037] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:31.540972 26443 raft_consensus.cc:3037] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:58:31.542258 26443 raft_consensus.cc:2454] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd5c1b6921464e00bc98b1508083a64a in term 1.
I20260809 01:58:31.542258 26294 raft_consensus.cc:2454] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd5c1b6921464e00bc98b1508083a64a in term 1.
I20260809 01:58:31.542538 26519 leader_election.cc:302] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd5c1b6921464e00bc98b1508083a64a, f91a439be55b45d09ed9ed7620b8f9e8; no voters:
I20260809 01:58:31.542698 26666 raft_consensus.cc:2781] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:58:31.542997 26666 raft_consensus.cc:686] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 1 LEADER]: Becoming Leader. State: Replica: bd5c1b6921464e00bc98b1508083a64a, State: Running, Role: LEADER
I20260809 01:58:31.543319 26666 consensus_queue.cc:237] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } }
I20260809 01:58:31.546526 26136 catalog_manager.cc:5495] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a reported cstate change: term changed from 0 to 1, leader changed from <none> to bd5c1b6921464e00bc98b1508083a64a (127.14.175.195). New cstate: current_term: 1 leader_uuid: "bd5c1b6921464e00bc98b1508083a64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd5c1b6921464e00bc98b1508083a64a" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 } health_report { overall_health: UNKNOWN } } }
I20260809 01:58:31.571931 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.568480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59866 (local address 127.14.175.195:33365)
0809 01:58:31.568611 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 01:58:31.568615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:58:31.568628 (+ 13us) server_negotiation.cc:407] Connection header received
0809 01:58:31.568773 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:58:31.568775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:58:31.568853 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:58:31.568936 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:58:31.569157 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.569633 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.570524 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:58:31.570739 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:58:31.570864 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:58:31.571137 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:58:31.571528 (+ 391us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:58:31.571616 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 01:58:31.571679 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 01:58:31.571724 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 01:58:31.577337 26443 raft_consensus.cc:1261] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 1 FOLLOWER]: Refusing update from remote peer bd5c1b6921464e00bc98b1508083a64a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:31.577344 26294 raft_consensus.cc:1261] T ea34906524964654bfb87d42b1f747f5 P f91a439be55b45d09ed9ed7620b8f9e8 [term 1 FOLLOWER]: Refusing update from remote peer bd5c1b6921464e00bc98b1508083a64a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:58:31.578004 26670 consensus_queue.cc:1035] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7904c15063ab450aa08449f04f567414" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:31.578153 26666 consensus_queue.cc:1035] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91a439be55b45d09ed9ed7620b8f9e8" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:58:31.588400 26674 mvcc.cc:205] Tried to move back new op lower bound from 7316441954614259712 to 7316441954484326400. Current Snapshot: MvccSnapshot[applied={T|T < 7316441954614259712}]
I20260809 01:58:31.594237 26136 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:31.594434 26136 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:58:31.596909 26136 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 857bf822f7cc41119ab11c3db19f3aa3: Sending DeleteTablet for 3 replicas of tablet ea34906524964654bfb87d42b1f747f5
I20260809 01:58:31.597692 26566 tablet_service.cc:1514] Processing DeleteTablet for tablet ea34906524964654bfb87d42b1f747f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:59850
I20260809 01:58:31.597738 26271 tablet_service.cc:1514] Processing DeleteTablet for tablet ea34906524964654bfb87d42b1f747f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:42174
I20260809 01:58:31.598137 26683 tablet_replica.cc:330] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: stopping tablet replica
I20260809 01:58:31.598182 26421 tablet_service.cc:1514] Processing DeleteTablet for tablet ea34906524964654bfb87d42b1f747f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:58:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:58112
I20260809 01:58:31.598357 26683 raft_consensus.cc:2229] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:58:31.598642 26685 tablet_replica.cc:330] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: stopping tablet replica
I20260809 01:58:31.598719 26683 raft_consensus.cc:2258] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:31.599080 26685 raft_consensus.cc:2229] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:58:31.599357 26685 raft_consensus.cc:2258] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:58:31.599539 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 26206
I20260809 01:58:31.600172 26683 ts_tablet_manager.cc:1905] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:31.600893 26685 ts_tablet_manager.cc:1905] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:58:31.603050 26683 ts_tablet_manager.cc:1918] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:31.603137 26683 log.cc:1196] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/ea34906524964654bfb87d42b1f747f5
I20260809 01:58:31.603471 26683 ts_tablet_manager.cc:1939] T ea34906524964654bfb87d42b1f747f5 P bd5c1b6921464e00bc98b1508083a64a: Deleting consensus metadata
I20260809 01:58:31.603899 26685 ts_tablet_manager.cc:1918] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:58:31.603981 26685 log.cc:1196] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/ea34906524964654bfb87d42b1f747f5
I20260809 01:58:31.604274 26685 ts_tablet_manager.cc:1939] T ea34906524964654bfb87d42b1f747f5 P 7904c15063ab450aa08449f04f567414: Deleting consensus metadata
I20260809 01:58:31.604699 26120 catalog_manager.cc:4841] TS bd5c1b6921464e00bc98b1508083a64a (127.14.175.195:33365): tablet ea34906524964654bfb87d42b1f747f5 (table test-table [id=5e4125bc7bbf4ef297b78256df1d70fc]) successfully deleted
I20260809 01:58:31.606604 26120 catalog_manager.cc:4841] TS 7904c15063ab450aa08449f04f567414 (127.14.175.194:44133): tablet ea34906524964654bfb87d42b1f747f5 (table test-table [id=5e4125bc7bbf4ef297b78256df1d70fc]) successfully deleted
W20260809 01:58:31.612464 26123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:42261 (error 108)
I20260809 01:58:31.612680 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 26352
I20260809 01:58:31.615527 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:58:31.615056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42261 (local address 127.0.0.1:42182)
0809 01:58:31.615347 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 01:58:31.615410 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
W20260809 01:58:31.619092 26123 catalog_manager.cc:4584] TS f91a439be55b45d09ed9ed7620b8f9e8 (127.14.175.193:42261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea34906524964654bfb87d42b1f747f5: Network error: Client connection negotiation failed: client connection to 127.14.175.193:42261: connect: Connection refused (error 111)
I20260809 01:58:31.621272 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 26499
I20260809 01:58:31.629156 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 26102
2026-08-09T01:58:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2388 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26689](info): set up 2 sockets
Aug 09 01:58:31 dist-test-slave-2w3w krb5kdc[26689](info): commencing operation
krb5kdc: starting...
W20260809 01:58:32.696703 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:58:32 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:58:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:58:32Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangeradmin_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangeradmin_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangerlookup_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangerlookup_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
I20260809 01:58:32.870340 15039 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXh4dFo/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/postgres -l logfile start
2026-08-09 01:58:35.392 UTC [26724] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 01:58:35.392 UTC [26724] LOG: listening on IPv4 address "127.14.175.212", port 49459
2026-08-09 01:58:35.396 UTC [26724] LOG: listening on Unix socket "/tmp/.s.PGSQL.49459"
2026-08-09 01:58:35.418 UTC [26727] LOG: database system was shut down at 2026-08-09 01:58:34 UTC
2026-08-09 01:58:35.421 UTC [26724] LOG: database system is ready to accept connections
I20260809 01:58:36.404716 15039 mini_postgres.cc:96] Postgres bound to 49459
2026-08-09 01:58:36.414 UTC [26735] FATAL: database "slave" does not exist
127.14.175.212:49459 - accepting connections
I20260809 01:58:36.415207 15039 mini_ranger.cc:161] Starting Ranger...
I20260809 01:58:36.432189 15039 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 01:58:36.899511 15039 mini_ranger.cc:87] Created ranger Postgres database
I20260809 01:58:36.899596 15039 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin
2026-08-09 01:58:37,266 [I] DB FLAVOR :POSTGRES
2026-08-09 01:58:37,266 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 01:58:37,266 [I] Checking connection..
2026-08-09 01:58:37,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 01:58:37,547 [I] Checking connection passed.
2026-08-09 01:58:37,548 [I] --------- Verifying version history table ---------
2026-08-09 01:58:37,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:58:37,813 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 01:58:37,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:58:38,065 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 01:58:38,065 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 01:58:38,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 01:58:38.318 UTC [26808] WARNING: there is no transaction in progress
2026-08-09 01:58:38,325 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 01:58:38,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:58:38,575 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 01:58:38,575 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 01:58:38,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 01:58:38,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 01:58:39,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-09 01:58:39,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 01:58:39,591 [I] Table x_portal_user does not exist in database ranger
2026-08-09 01:58:39,591 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 01:58:39,844 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 01:58:39,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 01:58:40,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 01:58:40,367 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 01:58:40,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 01:58:41.328 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.344 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.360 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.375 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.390 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.408 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.463 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.470 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.484 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.495 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.505 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.518 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.528 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.534 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.541 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:41.547 UTC [26928] WARNING: there is no transaction in progress
2026-08-09 01:58:42,149 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 01:58:42,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 01:58:42,380 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 01:58:42,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 01:58:42,616 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 01:58:42,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 01:58:42,881 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 01:58:42,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 01:58:43,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 01:58:43,391 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-09 01:58:43,641 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 01:58:43,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 01:58:43,874 [I] DB_PATCHES have already been applied
I20260809 01:58:43.879787 15039 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXh4dFo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 01:58:43.879846 15039 mini_ranger.cc:193] Using host: 127.14.175.212
I20260809 01:58:43.884024 15039 mini_ranger.cc:227] Ranger admin URL: http://127.14.175.212:54189
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 1:58:44 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 01:58:45.015041 15039 mini_ranger.cc:160] Time spent starting Ranger: real 8.600s user 0.006s sys 0.006s
Aug 09, 2026 1:59:04 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 1:59:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 1:59:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 1:59:04 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 1:59:05 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 01:59:06.454200 15039 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangerkms_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/rangerkms_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 01:59:06 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240746, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 01:59:06.562176 15039 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 01:59:06.574337 15039 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 01:59:07.436571 15039 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 01:59:07.436689 15039 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms
I20260809 01:59:07.436856 15039 mini_ranger_kms.cc:227] Using postgres at 127.14.175.212:49459
2026-08-09 01:59:07,770 [I] DB FLAVOR :POSTGRES
2026-08-09 01:59:07,770 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 01:59:07,770 [I] Checking connection
2026-08-09 01:59:07,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 01:59:08,009 [I] connection success
2026-08-09 01:59:08,009 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 01:59:08,009 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 01:59:08,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 01:59:08,237 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 01:59:08,238 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 01:59:08,238 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 01:59:08,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:49459/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 01:59:08,510 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 01:59:08.979810 15039 mini_ranger_kms.cc:310] Created kms service
I20260809 01:59:09.158663 15039 mini_ranger_kms.cc:326] Created kudu user
I20260809 01:59:09.202149 15039 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 01:59:09 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240746, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:09.590595 15039 mini_ranger_kms.cc:384] Added ranger policy
I20260809 01:59:09.590744 15039 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 01:59:09.590766 15039 mini_ranger_kms.cc:240] Using host: 127.14.175.212
I20260809 01:59:09.595335 15039 mini_ranger_kms.cc:276] Ranger KMS PID: 27127
I20260809 01:59:09.595470 15039 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.175.212:43735
Aug 09, 2026 1:59:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:59:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:59:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 1:59:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 1:59:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 1:59:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 01:59:11 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786240751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:11.973978 15039 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.412s user 0.017s sys 0.301s
I20260809 01:59:11.974126 15039 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 01:59:11.974246 15039 mini_ranger_kms.cc:401] 127.14.175.212:43735/kms/v1/keys
Aug 09 01:59:12 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
Aug 09 01:59:12 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
Aug 09 01:59:14 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 01:59:14.982236 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39399
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39399
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:43735/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:59:15.138028 27183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:59:15.138316 27183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:59:15.138399 27183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:59:15.142473 27183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 01:59:15.142573 27183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:59:15.142616 27183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:59:15.142652 27183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 01:59:15.142683 27183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 01:59:15.148078 27183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.175.212:43735/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39399
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:59:15.149080 27183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:59:15.150094 27183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:59:15.158834 27188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:15.159032 27183 server_base.cc:1034] running on GCE node
W20260809 01:59:15.158948 27189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:15.159116 27191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:15.159696 27183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:59:15.160833 27183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:59:15.162019 27183 hybrid_clock.cc:648] HybridClock initialized: now 1786240755161990 us; error 42 us; skew 500 ppm
Aug 09 01:59:15 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240755, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:15.164796 27183 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 01:59:15.165750 27183 webserver.cc:460] Webserver started at http://127.14.175.254:44413/ using document root <none> and password file <none>
I20260809 01:59:15.166278 27183 fs_manager.cc:359] Metadata directory not provided
I20260809 01:59:15.166334 27183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:59:15.166558 27183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 01:59:15 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240755, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:15.228324 27183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "93f4df17686c4881ad80e5054a9214d0"
format_stamp: "Formatted at 2026-08-09 01:59:15 on dist-test-slave-2w3w"
server_key: "5d3306053d67c47c1136d85663c87f95"
server_key_iv: "d7761056afa1b74e84f4ed8303324de2"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:15.228958 27183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "93f4df17686c4881ad80e5054a9214d0"
format_stamp: "Formatted at 2026-08-09 01:59:15 on dist-test-slave-2w3w"
server_key: "5d3306053d67c47c1136d85663c87f95"
server_key_iv: "d7761056afa1b74e84f4ed8303324de2"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:15.232892 27183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 01:59:15.247252 27198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:15.248682 27183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 01:59:15.248836 27183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "93f4df17686c4881ad80e5054a9214d0"
format_stamp: "Formatted at 2026-08-09 01:59:15 on dist-test-slave-2w3w"
server_key: "5d3306053d67c47c1136d85663c87f95"
server_key_iv: "d7761056afa1b74e84f4ed8303324de2"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:15.248989 27183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:59:15.284900 27183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:59:15.287915 27183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:59:15.288115 27183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:59:15.296497 27183 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:39399
I20260809 01:59:15.296563 27254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:39399 every 8 connection(s)
I20260809 01:59:15.297477 27183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 01:59:15.300992 27256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:59:15.301060 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 27183
I20260809 01:59:15.301191 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 01:59:15.301476 15039 external_mini_cluster.cc:1428] Setting key 77192c2f174dee563b1cf27c49e255bf
I20260809 01:59:15.308637 27256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: Bootstrap starting.
Aug 09 01:59:15 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:59:15.311376 27256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:59:15.312685 27256 log.cc:824] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: Log is configured to *not* fsync() on all Append() calls
I20260809 01:59:15.315150 27256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: No bootstrap required, opened a new log
I20260809 01:59:15.315914 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:15.302780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55600 (local address 127.14.175.254:39399)
0809 01:59:15.303238 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:15.303259 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:15.303479 (+ 220us) server_negotiation.cc:407] Connection header received
0809 01:59:15.304437 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:15.304455 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:15.304771 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:15.305100 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:59:15.305885 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:15.306868 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:15.307786 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:15.308252 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:15.308430 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:15.311072 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:59:15.311078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:59:15.311090 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:59:15.311116 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:59:15.312758 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:15.313288 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:15.313295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:15.313301 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:15.313444 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:15.313770 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:15.313775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:15.313777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:15.314167 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:59:15.314368 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:15.314673 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 01:59:15.315177 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":195,"threads_started":1}
I20260809 01:59:15.319058 27256 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } }
I20260809 01:59:15.319325 27256 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:59:15.319391 27256 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f4df17686c4881ad80e5054a9214d0, State: Initialized, Role: FOLLOWER
I20260809 01:59:15.319835 27256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } }
I20260809 01:59:15.320004 27256 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 01:59:15.320075 27256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 01:59:15.320170 27256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:59:15.321338 27256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } }
I20260809 01:59:15.321691 27256 leader_election.cc:302] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93f4df17686c4881ad80e5054a9214d0; no voters:
I20260809 01:59:15.322078 27256 leader_election.cc:288] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 01:59:15.322201 27261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:59:15.322461 27261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [term 1 LEADER]: Becoming Leader. State: Replica: 93f4df17686c4881ad80e5054a9214d0, State: Running, Role: LEADER
I20260809 01:59:15.322837 27261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } }
I20260809 01:59:15.323380 27256 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 01:59:15.324038 27261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93f4df17686c4881ad80e5054a9214d0. Latest consensus state: current_term: 1 leader_uuid: "93f4df17686c4881ad80e5054a9214d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } } }
I20260809 01:59:15.324247 27261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [sys.catalog]: This master's current role is: LEADER
I20260809 01:59:15.324524 27263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93f4df17686c4881ad80e5054a9214d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93f4df17686c4881ad80e5054a9214d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39399 } } }
I20260809 01:59:15.324689 27263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0 [sys.catalog]: This master's current role is: LEADER
I20260809 01:59:15.324869 27270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 01:59:15.329999 27270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 01:59:15.330627 27256 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 01:59:15.340554 27270 catalog_manager.cc:1347] Generated new cluster ID: afd9e669820a4ba7ae95805b5ac41f18
I20260809 01:59:15.340689 27270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 01:59:15.352229 27270 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 01:59:15.353542 27270 catalog_manager.cc:1504] Loading token signing keys...
I20260809 01:59:15.363307 27270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: Generated new TSK 0
I20260809 01:59:15.364233 27270 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 01:59:16.146874 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:43735/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:59:16.291685 27302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:59:16.292006 27302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:59:16.292114 27302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:59:16.296527 27302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:59:16.296651 27302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:59:16.296773 27302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 01:59:16.304271 27302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.175.212:43735/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:59:16.305600 27302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:59:16.306854 27302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 01:59:16.317199 27302 server_base.cc:1034] running on GCE node
W20260809 01:59:16.317341 27309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:16.317214 27313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:16.317188 27311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:16.317900 27302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:59:16.318527 27302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:59:16.319718 27302 hybrid_clock.cc:648] HybridClock initialized: now 1786240756319666 us; error 51 us; skew 500 ppm
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:16.322576 27302 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 01:59:16.323647 27302 webserver.cc:460] Webserver started at http://127.14.175.193:41397/ using document root <none> and password file <none>
I20260809 01:59:16.324411 27302 fs_manager.cc:359] Metadata directory not provided
I20260809 01:59:16.324501 27302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:59:16.324712 27302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:16.353747 27302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "16815a2f0fe74092b4a2c0cbbcd013d0"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "d7cb4fc02723f059d04e769aee83008f"
server_key_iv: "a3394fb94eb1787587b3abc9d1eaad87"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.357568 27302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "16815a2f0fe74092b4a2c0cbbcd013d0"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "d7cb4fc02723f059d04e769aee83008f"
server_key_iv: "a3394fb94eb1787587b3abc9d1eaad87"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.362886 27302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 01:59:16.382927 27322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.384657 27302 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 01:59:16.384807 27302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "16815a2f0fe74092b4a2c0cbbcd013d0"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "d7cb4fc02723f059d04e769aee83008f"
server_key_iv: "a3394fb94eb1787587b3abc9d1eaad87"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.384943 27302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:59:16.412946 27302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:59:16.416736 27302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:59:16.416997 27302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:59:16.417685 27302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:59:16.418772 27302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:59:16.418881 27302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.419059 27302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:59:16.419143 27302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.431834 27302 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:42397
I20260809 01:59:16.434419 27302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 01:59:16.436591 27441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:42397 every 8 connection(s)
I20260809 01:59:16.442214 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 27302
I20260809 01:59:16.442355 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 01:59:16.442684 15039 external_mini_cluster.cc:1428] Setting key fde165ea0d09da73fa645cb0c4a92aa5
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:59:16.456874 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:16.440506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:48025 (local address 127.14.175.254:39399)
0809 01:59:16.442456 (+ 1950us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:16.442461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:16.442476 (+ 15us) server_negotiation.cc:407] Connection header received
0809 01:59:16.442521 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:16.442525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:16.442575 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:16.442667 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:59:16.445414 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.446280 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.448108 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.448492 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.448573 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:16.451836 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:59:16.451840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:59:16.451843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:59:16.451869 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:59:16.454250 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:16.454973 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:16.454977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:16.454979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:16.455072 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:16.455537 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:16.455543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:16.455546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:16.455780 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:59:16.455873 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:16.456545 (+ 672us) server_negotiation.cc:299] Negotiation successful
0809 01:59:16.456678 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1867,"thread_start_us":86,"threads_started":1}
I20260809 01:59:16.458874 27445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:16.439414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39399 (local address 127.14.175.193:48025)
0809 01:59:16.440928 (+ 1514us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:16.440986 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:16.442013 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:16.442996 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:16.443005 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:16.444592 (+ 1587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:59:16.445236 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:16.445254 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.446439 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.446443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:16.447954 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:16.447969 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.448804 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.448808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:16.449007 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:16.449711 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:59:16.449731 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:59:16.451636 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:59:16.454413 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:16.454420 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:16.454435 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:16.454825 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:16.455189 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:16.455192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:16.455194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:16.455399 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:16.455943 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:59:16.455950 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:59:16.456253 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 01:59:16.457439 (+ 1186us) client_negotiation.cc:240] Negotiation successful
0809 01:59:16.457821 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1286,"thread_start_us":129,"threads_started":1}
I20260809 01:59:16.460979 27442 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39399
I20260809 01:59:16.461210 27442 heartbeater.cc:464] Registering TS with master...
I20260809 01:59:16.461763 27442 heartbeater.cc:511] Master 127.14.175.254:39399 requested a full tablet report, sending...
I20260809 01:59:16.463532 27216 ts_manager.cc:194] Registered new tserver with Master: 16815a2f0fe74092b4a2c0cbbcd013d0 (127.14.175.193:42397)
I20260809 01:59:16.465026 27216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:48025
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 01:59:16.498204 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:43735/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 01:59:16.647033 27449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:59:16.647439 27449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:59:16.647564 27449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:59:16.653487 27449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:59:16.653623 27449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:59:16.653759 27449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 01:59:16.661258 27449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.175.212:43735/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:59:16.662719 27449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:59:16.664117 27449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:59:16.683712 27456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:16.684224 27455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:16.684890 27449 server_base.cc:1034] running on GCE node
W20260809 01:59:16.685475 27458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:16.686024 27449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:59:16.686774 27449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:59:16.690086 27449 hybrid_clock.cc:648] HybridClock initialized: now 1786240756690046 us; error 45 us; skew 500 ppm
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:16.694170 27449 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 01:59:16.695271 27449 webserver.cc:460] Webserver started at http://127.14.175.194:40293/ using document root <none> and password file <none>
I20260809 01:59:16.695983 27449 fs_manager.cc:359] Metadata directory not provided
I20260809 01:59:16.696116 27449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:59:16.696368 27449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:16.712580 27449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "f7570e5f5d8e4c5fba66fe3d0944f596"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "3ad6ab73e1f73d2450bd3fca7bb6af03"
server_key_iv: "3a02143f993a8e8cae14e144b4b96dbb"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.713382 27449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "f7570e5f5d8e4c5fba66fe3d0944f596"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "3ad6ab73e1f73d2450bd3fca7bb6af03"
server_key_iv: "3a02143f993a8e8cae14e144b4b96dbb"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.718791 27449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 01:59:16.742900 27466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.744560 27449 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.000s
I20260809 01:59:16.744760 27449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "f7570e5f5d8e4c5fba66fe3d0944f596"
format_stamp: "Formatted at 2026-08-09 01:59:16 on dist-test-slave-2w3w"
server_key: "3ad6ab73e1f73d2450bd3fca7bb6af03"
server_key_iv: "3a02143f993a8e8cae14e144b4b96dbb"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:16.744974 27449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:59:16.776083 27449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:59:16.779157 27449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:59:16.779363 27449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:59:16.780045 27449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:59:16.780941 27449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:59:16.781013 27449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.781083 27449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:59:16.781136 27449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:16.792711 27449 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:39067
I20260809 01:59:16.792757 27589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:39067 every 8 connection(s)
I20260809 01:59:16.793766 27449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 01:59:16.794458 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 27449
I20260809 01:59:16.794610 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 01:59:16.795037 15039 external_mini_cluster.cc:1428] Setting key 10fc8159cbdd170e7a9715e0519c8529
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:59:16.820389 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:16.799293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:33983 (local address 127.14.175.254:39399)
0809 01:59:16.799427 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:16.799431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:16.806947 (+ 7516us) server_negotiation.cc:407] Connection header received
0809 01:59:16.808535 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:16.808540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:16.808596 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:16.808653 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:59:16.810381 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.811320 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.812703 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.812930 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.813044 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:16.815987 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:59:16.815993 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:59:16.815999 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:59:16.816037 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:59:16.817893 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:16.818383 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:16.818390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:16.818394 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:16.818489 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:16.818899 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:16.818906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:16.818910 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:16.819176 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:59:16.819258 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:16.820007 (+ 749us) server_negotiation.cc:299] Negotiation successful
0809 01:59:16.820161 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 01:59:16.822149 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:16.796152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39399 (local address 127.14.175.194:33983)
0809 01:59:16.806766 (+ 10614us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:16.806842 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:16.808226 (+ 1384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:16.809100 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:16.809112 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:16.809490 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:59:16.810198 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:16.810222 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.811497 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.811503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:16.812576 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:16.812587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:16.813092 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:16.813096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:16.813261 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:16.813916 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:59:16.813932 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:59:16.815789 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:59:16.818003 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:16.818010 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:16.818024 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:16.818270 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:16.818599 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:16.818605 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:16.818609 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:16.818786 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:16.819356 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:59:16.819365 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:59:16.819709 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 01:59:16.820775 (+ 1066us) client_negotiation.cc:240] Negotiation successful
0809 01:59:16.821113 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10366,"thread_start_us":131,"threads_started":1}
I20260809 01:59:16.824049 27590 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39399
I20260809 01:59:16.824319 27590 heartbeater.cc:464] Registering TS with master...
I20260809 01:59:16.824939 27590 heartbeater.cc:511] Master 127.14.175.254:39399 requested a full tablet report, sending...
I20260809 01:59:16.826138 27216 ts_manager.cc:194] Registered new tserver with Master: f7570e5f5d8e4c5fba66fe3d0944f596 (127.14.175.194:39067)
I20260809 01:59:16.826844 27216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:33983
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 01:59:16.838042 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:43735/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 01:59:16 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
W20260809 01:59:16.995819 27595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 01:59:16.996271 27595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 01:59:16.996405 27595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 01:59:17.002319 27595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 01:59:17.002462 27595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 01:59:17.002605 27595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 01:59:17.010458 27595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.175.212:43735/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:39399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 01:59:17.012042 27595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 01:59:17.013479 27595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 01:59:17.025769 27602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:17.026252 27600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 01:59:17.026530 27604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 01:59:17.028083 27595 server_base.cc:1034] running on GCE node
I20260809 01:59:17.028697 27595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 01:59:17.029421 27595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 01:59:17.030596 27595 hybrid_clock.cc:648] HybridClock initialized: now 1786240757030530 us; error 83 us; skew 500 ppm
Aug 09 01:59:17 dist-test-slave-2w3w krb5kdc[26689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240757, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:17.034336 27595 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 01:59:17.035436 27595 webserver.cc:460] Webserver started at http://127.14.175.195:44935/ using document root <none> and password file <none>
I20260809 01:59:17.036109 27595 fs_manager.cc:359] Metadata directory not provided
I20260809 01:59:17.036177 27595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 01:59:17.036401 27595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 01:59:17 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240757, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:17.070477 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "44628a963765451aa6ab3a7be9d9a881"
format_stamp: "Formatted at 2026-08-09 01:59:17 on dist-test-slave-2w3w"
server_key: "69b0d190e1b97191413d22c1c32745bd"
server_key_iv: "27b2fe9d248b5a645ec887bd8355fb42"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:17.079447 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "44628a963765451aa6ab3a7be9d9a881"
format_stamp: "Formatted at 2026-08-09 01:59:17 on dist-test-slave-2w3w"
server_key: "69b0d190e1b97191413d22c1c32745bd"
server_key_iv: "27b2fe9d248b5a645ec887bd8355fb42"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:17.100757 27595 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.004s sys 0.000s
I20260809 01:59:17.124837 27612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:17.126319 27595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 01:59:17.126457 27595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "44628a963765451aa6ab3a7be9d9a881"
format_stamp: "Formatted at 2026-08-09 01:59:17 on dist-test-slave-2w3w"
server_key: "69b0d190e1b97191413d22c1c32745bd"
server_key_iv: "27b2fe9d248b5a645ec887bd8355fb42"
server_key_version: "kuduclusterkey@0"
I20260809 01:59:17.126617 27595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 01:59:17.157671 27595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 01:59:17.161469 27595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 01:59:17.161723 27595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 01:59:17.162513 27595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 01:59:17.163717 27595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 01:59:17.163846 27595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:17.163955 27595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 01:59:17.164031 27595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 01:59:17.178030 27595 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:42497
I20260809 01:59:17.180634 27732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:42497 every 8 connection(s)
I20260809 01:59:17.181303 27595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 01:59:17.188095 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 27595
I20260809 01:59:17.188241 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 01:59:17.188627 15039 external_mini_cluster.cc:1428] Setting key 439afbbacb935bbb6b1708ebe90d6f97
Aug 09 01:59:17 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240757, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 01:59:17.202526 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.185711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:47335 (local address 127.14.175.254:39399)
0809 01:59:17.185843 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.185848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.186299 (+ 451us) server_negotiation.cc:407] Connection header received
0809 01:59:17.187585 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.187589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.187644 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.187700 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:59:17.191284 (+ 3584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.192128 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.193892 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.194217 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.194315 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.197492 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:59:17.197496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:59:17.197499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:59:17.197527 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:59:17.199413 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:17.200056 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:17.200059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:17.200061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:17.200152 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:17.200592 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:17.200595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:17.200597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:17.200826 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:59:17.200918 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.202199 (+ 1281us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.202343 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:59:17.205211 27735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.184626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39399 (local address 127.14.175.195:47335)
0809 01:59:17.186126 (+ 1500us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.186180 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.187335 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.188360 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.188369 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.188815 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 01:59:17.191102 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.191125 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.192319 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.192323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.193746 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.193758 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.194537 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.194541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.194739 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.195528 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 01:59:17.195548 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 01:59:17.197298 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 01:59:17.199566 (+ 2268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:17.199571 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:17.199588 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:17.199931 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:17.200283 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 01:59:17.200286 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 01:59:17.200288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 01:59:17.200471 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 01:59:17.200991 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 01:59:17.200997 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 01:59:17.201312 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.203789 (+ 2477us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.204149 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"thread_start_us":140,"threads_started":1}
I20260809 01:59:17.206684 27733 heartbeater.cc:347] Connected to a master server at 127.14.175.254:39399
I20260809 01:59:17.206923 27733 heartbeater.cc:464] Registering TS with master...
I20260809 01:59:17.207499 27733 heartbeater.cc:511] Master 127.14.175.254:39399 requested a full tablet report, sending...
I20260809 01:59:17.208626 27216 ts_manager.cc:194] Registered new tserver with Master: 44628a963765451aa6ab3a7be9d9a881 (127.14.175.195:42497)
I20260809 01:59:17.209363 27216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:47335
I20260809 01:59:17.215487 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 01:59:17.228485 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.217991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55614 (local address 127.14.175.254:39399)
0809 01:59:17.218125 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.218129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.218780 (+ 651us) server_negotiation.cc:407] Connection header received
0809 01:59:17.219037 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.219040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.219097 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.219154 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 01:59:17.220276 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.221046 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.222253 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.222603 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.222685 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.224655 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 01:59:17.224659 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 01:59:17.224662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 01:59:17.224688 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 01:59:17.226456 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:17.227005 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:17.227009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:17.227011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:17.227099 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 01:59:17.227460 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 01:59:17.227463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 01:59:17.227465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 01:59:17.227684 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 01:59:17.227791 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.228190 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.228312 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 01:59:17.232542 27216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 01:59:17.237527 27216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 01:59:17.267578 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.252459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42397 (local address 127.0.0.1:49112)
0809 01:59:17.255156 (+ 2697us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.255207 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.255331 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.258390 (+ 3059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.258393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.258409 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:59:17.258485 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.258490 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.260615 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.260618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.262057 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.262069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.266994 (+ 4925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.266998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.267126 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.267167 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.267283 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.267416 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2557,"mutex_wait_us":3,"thread_start_us":127,"threads_started":1}
I20260809 01:59:17.269534 27753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.253930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51324 (local address 127.14.175.194:39067)
0809 01:59:17.256354 (+ 2424us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.256370 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.263386 (+ 7016us) server_negotiation.cc:407] Connection header received
0809 01:59:17.263480 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.263486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.263698 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.263888 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:59:17.264348 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.265645 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.267391 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.268309 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.268448 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.268593 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.269262 (+ 669us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.269379 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2324,"thread_start_us":76,"threads_started":1}
I20260809 01:59:17.270922 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.252939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.14.175.193:42397)
0809 01:59:17.255605 (+ 2666us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.255613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.255637 (+ 24us) server_negotiation.cc:407] Connection header received
0809 01:59:17.255716 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.255721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.255939 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.256084 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:59:17.258606 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.259802 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.265694 (+ 5892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.266626 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.266751 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.266904 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.270664 (+ 3760us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.270769 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2562,"thread_start_us":82,"threads_started":1}
I20260809 01:59:17.269142 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.253763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:39067 (local address 127.0.0.1:51324)
0809 01:59:17.263143 (+ 9380us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.263160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.263271 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.264062 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.264066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.264087 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:59:17.264193 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.264200 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.265806 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.265809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.267198 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.267211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.268669 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.268673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.268780 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.268806 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.268910 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.268986 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9305,"thread_start_us":105,"threads_started":1}
I20260809 01:59:17.271545 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.250926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.14.175.195:42497)
0809 01:59:17.257496 (+ 6570us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.257510 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.257533 (+ 23us) server_negotiation.cc:407] Connection header received
0809 01:59:17.257602 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.257607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.257797 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.257945 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:59:17.262217 (+ 4272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.263402 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.267972 (+ 4570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.269593 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.269714 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.269851 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.271305 (+ 1454us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.271407 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5738,"thread_start_us":148,"threads_started":1}
I20260809 01:59:17.270315 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.249846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:42497 (local address 127.0.0.1:32930)
0809 01:59:17.256422 (+ 6576us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.256436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.256523 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.258109 (+ 1586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.258115 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.258138 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:59:17.258268 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.258275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.263541 (+ 5266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.263544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.265469 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.265481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.269928 (+ 4447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.269932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.270027 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.270050 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.270124 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.270187 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5045,"thread_start_us":108,"threads_started":1}
I20260809 01:59:17.274475 27371 tablet_service.cc:1467] Processing CreateTablet for tablet 7863865c6741481082270bec883ed779 (DEFAULT_TABLE table=test-table [id=4ecc37f3f28f4c64b8704c054b8fcd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:59:17.274482 27519 tablet_service.cc:1467] Processing CreateTablet for tablet 7863865c6741481082270bec883ed779 (DEFAULT_TABLE table=test-table [id=4ecc37f3f28f4c64b8704c054b8fcd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:59:17.275681 27519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7863865c6741481082270bec883ed779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:59:17.275682 27371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7863865c6741481082270bec883ed779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:59:17.286075 27661 tablet_service.cc:1467] Processing CreateTablet for tablet 7863865c6741481082270bec883ed779 (DEFAULT_TABLE table=test-table [id=4ecc37f3f28f4c64b8704c054b8fcd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 01:59:17.287235 27661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7863865c6741481082270bec883ed779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 01:59:17.300465 27754 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Bootstrap starting.
I20260809 01:59:17.303665 27754 tablet_bootstrap.cc:654] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Neither blocks nor log segments found. Creating new log.
I20260809 01:59:17.313617 27755 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Bootstrap starting.
I20260809 01:59:17.314122 27756 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Bootstrap starting.
I20260809 01:59:17.315946 27754 log.cc:824] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Log is configured to *not* fsync() on all Append() calls
I20260809 01:59:17.318604 27755 tablet_bootstrap.cc:654] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Neither blocks nor log segments found. Creating new log.
I20260809 01:59:17.319538 27756 tablet_bootstrap.cc:654] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Neither blocks nor log segments found. Creating new log.
I20260809 01:59:17.321758 27756 log.cc:824] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Log is configured to *not* fsync() on all Append() calls
I20260809 01:59:17.323565 27755 log.cc:824] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Log is configured to *not* fsync() on all Append() calls
I20260809 01:59:17.326848 27756 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: No bootstrap required, opened a new log
I20260809 01:59:17.327121 27756 ts_tablet_manager.cc:1397] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260809 01:59:17.328390 27754 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: No bootstrap required, opened a new log
I20260809 01:59:17.328689 27754 ts_tablet_manager.cc:1397] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260809 01:59:17.333094 27754 raft_consensus.cc:348] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.333626 27754 raft_consensus.cc:374] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:59:17.333742 27755 tablet_bootstrap.cc:492] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: No bootstrap required, opened a new log
I20260809 01:59:17.333746 27754 raft_consensus.cc:729] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7570e5f5d8e4c5fba66fe3d0944f596, State: Initialized, Role: FOLLOWER
I20260809 01:59:17.334002 27755 ts_tablet_manager.cc:1397] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260809 01:59:17.335727 27754 consensus_queue.cc:260] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.338841 27755 raft_consensus.cc:348] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.339113 27755 raft_consensus.cc:374] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:59:17.339169 27755 raft_consensus.cc:729] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44628a963765451aa6ab3a7be9d9a881, State: Initialized, Role: FOLLOWER
I20260809 01:59:17.339597 27755 consensus_queue.cc:260] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.332206 27756 raft_consensus.cc:348] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.340615 27756 raft_consensus.cc:374] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 01:59:17.340680 27756 raft_consensus.cc:729] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16815a2f0fe74092b4a2c0cbbcd013d0, State: Initialized, Role: FOLLOWER
I20260809 01:59:17.341220 27755 ts_tablet_manager.cc:1428] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 01:59:17.341528 27754 ts_tablet_manager.cc:1428] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260809 01:59:17.341684 27756 consensus_queue.cc:260] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.342574 27756 ts_tablet_manager.cc:1428] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260809 01:59:17.342830 27590 heartbeater.cc:503] Master 127.14.175.254:39399 was elected leader, sending a full tablet report...
I20260809 01:59:17.342906 27733 heartbeater.cc:503] Master 127.14.175.254:39399 was elected leader, sending a full tablet report...
I20260809 01:59:17.347561 27442 heartbeater.cc:503] Master 127.14.175.254:39399 was elected leader, sending a full tablet report...
I20260809 01:59:17.370090 27761 raft_consensus.cc:482] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 01:59:17.370291 27761 raft_consensus.cc:504] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.371649 27761 leader_election.cc:288] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44628a963765451aa6ab3a7be9d9a881 (127.14.175.195:42497), 16815a2f0fe74092b4a2c0cbbcd013d0 (127.14.175.193:42397)
I20260809 01:59:17.389822 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.372608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:41045 (local address 127.14.175.193:42397)
0809 01:59:17.372732 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.372737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.381677 (+ 8940us) server_negotiation.cc:407] Connection header received
0809 01:59:17.381898 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.381901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.381959 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.382008 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:59:17.382669 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.383546 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.388396 (+ 4850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.389019 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.389120 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.389176 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.389586 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.389673 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 01:59:17.390563 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.372084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42397 (local address 127.14.175.194:41045)
0809 01:59:17.381576 (+ 9492us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.381592 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.381759 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.382153 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.382156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.382189 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:59:17.382300 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.382306 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.383693 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.383696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.385090 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.385102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.389276 (+ 4174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.389280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.389432 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.389456 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.390292 (+ 836us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.390389 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9414,"thread_start_us":127,"threads_started":1}
I20260809 01:59:17.392663 27377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7863865c6741481082270bec883ed779" candidate_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" is_pre_election: true
I20260809 01:59:17.392994 27377 raft_consensus.cc:2454] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7570e5f5d8e4c5fba66fe3d0944f596 in term 0.
I20260809 01:59:17.393637 27469 leader_election.cc:302] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16815a2f0fe74092b4a2c0cbbcd013d0, f7570e5f5d8e4c5fba66fe3d0944f596; no voters:
I20260809 01:59:17.393935 27761 raft_consensus.cc:2781] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 01:59:17.394003 27761 raft_consensus.cc:482] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 01:59:17.394042 27761 raft_consensus.cc:3037] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:59:17.395695 27761 raft_consensus.cc:504] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.396076 27761 leader_election.cc:288] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [CANDIDATE]: Term 1 election: Requested vote from peers 44628a963765451aa6ab3a7be9d9a881 (127.14.175.195:42497), 16815a2f0fe74092b4a2c0cbbcd013d0 (127.14.175.193:42397)
I20260809 01:59:17.396649 27377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7863865c6741481082270bec883ed779" candidate_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0"
I20260809 01:59:17.396773 27377 raft_consensus.cc:3037] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:59:17.398128 27377 raft_consensus.cc:2454] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7570e5f5d8e4c5fba66fe3d0944f596 in term 1.
I20260809 01:59:17.398562 27469 leader_election.cc:302] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16815a2f0fe74092b4a2c0cbbcd013d0, f7570e5f5d8e4c5fba66fe3d0944f596; no voters:
I20260809 01:59:17.398785 27761 raft_consensus.cc:2781] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 01:59:17.399039 27761 raft_consensus.cc:686] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 1 LEADER]: Becoming Leader. State: Replica: f7570e5f5d8e4c5fba66fe3d0944f596, State: Running, Role: LEADER
I20260809 01:59:17.399430 27761 consensus_queue.cc:237] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } }
I20260809 01:59:17.403028 27216 catalog_manager.cc:5495] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7570e5f5d8e4c5fba66fe3d0944f596 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 39067 } health_report { overall_health: HEALTHY } } }
I20260809 01:59:17.405750 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.373381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:49611 (local address 127.14.175.195:42497)
0809 01:59:17.373502 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.373507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.382594 (+ 9087us) server_negotiation.cc:407] Connection header received
0809 01:59:17.385385 (+ 2791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.385389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.385439 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.385486 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 01:59:17.385914 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.386705 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.390858 (+ 4153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.391569 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.391666 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.391712 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.405488 (+ 13776us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.405616 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 01:59:17.406428 27764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.372948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:42497 (local address 127.14.175.194:49611)
0809 01:59:17.382513 (+ 9565us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.382526 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 01:59:17.385240 (+ 2714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 01:59:17.385618 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 01:59:17.385621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 01:59:17.385637 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 01:59:17.385781 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.385787 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.386887 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.386890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.388216 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 01:59:17.388227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.391882 (+ 3655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.391885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 01:59:17.391983 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.392005 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 01:59:17.406108 (+ 14103us) client_negotiation.cc:240] Negotiation successful
0809 01:59:17.406210 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9505,"thread_start_us":110,"threads_started":1}
I20260809 01:59:17.407749 27666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7863865c6741481082270bec883ed779" candidate_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44628a963765451aa6ab3a7be9d9a881" is_pre_election: true
I20260809 01:59:17.408082 27666 raft_consensus.cc:2454] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7570e5f5d8e4c5fba66fe3d0944f596 in term 0.
I20260809 01:59:17.408473 27681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7863865c6741481082270bec883ed779" candidate_uuid: "f7570e5f5d8e4c5fba66fe3d0944f596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44628a963765451aa6ab3a7be9d9a881"
I20260809 01:59:17.408595 27681 raft_consensus.cc:3037] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 0 FOLLOWER]: Advancing to term 1
I20260809 01:59:17.410701 27681 raft_consensus.cc:2454] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7570e5f5d8e4c5fba66fe3d0944f596 in term 1.
I20260809 01:59:17.429180 27753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.423657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51334 (local address 127.14.175.194:39067)
0809 01:59:17.423776 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 01:59:17.423781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 01:59:17.423864 (+ 83us) server_negotiation.cc:407] Connection header received
0809 01:59:17.424053 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 01:59:17.424056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 01:59:17.424136 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 01:59:17.424240 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 01:59:17.424639 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.425486 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.426840 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 01:59:17.427225 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 01:59:17.427322 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 01:59:17.427772 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 01:59:17.428359 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 01:59:17.428482 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 01:59:17.428979 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 01:59:17.429041 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 01:59:17.432737 27734 tablet.cc:2369] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 01:59:17.440653 27443 tablet.cc:2369] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 01:59:17.444850 27377 raft_consensus.cc:1261] T 7863865c6741481082270bec883ed779 P 16815a2f0fe74092b4a2c0cbbcd013d0 [term 1 FOLLOWER]: Refusing update from remote peer f7570e5f5d8e4c5fba66fe3d0944f596: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:59:17.445710 27765 consensus_queue.cc:1035] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16815a2f0fe74092b4a2c0cbbcd013d0" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:59:17.453060 27681 raft_consensus.cc:1261] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 1 FOLLOWER]: Refusing update from remote peer f7570e5f5d8e4c5fba66fe3d0944f596: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 01:59:17.454254 27765 consensus_queue.cc:1035] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44628a963765451aa6ab3a7be9d9a881" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 42497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 01:59:17.464803 27769 mvcc.cc:205] Tried to move back new op lower bound from 7316442142485471232 to 7316442142311677952. Current Snapshot: MvccSnapshot[applied={T|T < 7316442142485471232}]
I20260809 01:59:17.467068 27770 mvcc.cc:205] Tried to move back new op lower bound from 7316442142485471232 to 7316442142311677952. Current Snapshot: MvccSnapshot[applied={T|T < 7316442142485471232}]
I20260809 01:59:17.474509 27772 mvcc.cc:205] Tried to move back new op lower bound from 7316442142485471232 to 7316442142311677952. Current Snapshot: MvccSnapshot[applied={T|T < 7316442142485471232}]
I20260809 01:59:17.486593 27216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:59:17.486774 27216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 01:59:17.489764 27216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93f4df17686c4881ad80e5054a9214d0: Sending DeleteTablet for 3 replicas of tablet 7863865c6741481082270bec883ed779
I20260809 01:59:17.491557 27661 tablet_service.cc:1514] Processing DeleteTablet for tablet 7863865c6741481082270bec883ed779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:59:17 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:32930
I20260809 01:59:17.490885 27371 tablet_service.cc:1514] Processing DeleteTablet for tablet 7863865c6741481082270bec883ed779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:59:17 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49112
I20260809 01:59:17.492944 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 27302
I20260809 01:59:17.493043 27519 tablet_service.cc:1514] Processing DeleteTablet for tablet 7863865c6741481082270bec883ed779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 01:59:17 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:51324
I20260809 01:59:17.495886 27782 tablet_replica.cc:330] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: stopping tablet replica
I20260809 01:59:17.496265 27782 raft_consensus.cc:2229] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 1 LEADER]: Raft consensus shutting down.
I20260809 01:59:17.496755 27782 raft_consensus.cc:2258] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:59:17.498594 27782 ts_tablet_manager.cc:1905] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:59:17.501981 27782 ts_tablet_manager.cc:1918] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:59:17.502180 27782 log.cc:1196] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/7863865c6741481082270bec883ed779
I20260809 01:59:17.502627 27782 ts_tablet_manager.cc:1939] T 7863865c6741481082270bec883ed779 P f7570e5f5d8e4c5fba66fe3d0944f596: Deleting consensus metadata
I20260809 01:59:17.503914 27200 catalog_manager.cc:4841] TS f7570e5f5d8e4c5fba66fe3d0944f596 (127.14.175.194:39067): tablet 7863865c6741481082270bec883ed779 (table test-table [id=4ecc37f3f28f4c64b8704c054b8fcd18]) successfully deleted
I20260809 01:59:17.513594 27779 tablet_replica.cc:330] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: stopping tablet replica
I20260809 01:59:17.513939 27779 raft_consensus.cc:2229] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 01:59:17.514252 27779 raft_consensus.cc:2258] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 01:59:17.524459 27779 ts_tablet_manager.cc:1905] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 01:59:17.527154 27779 ts_tablet_manager.cc:1918] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 01:59:17.527257 27779 log.cc:1196] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/7863865c6741481082270bec883ed779
I20260809 01:59:17.527915 27779 ts_tablet_manager.cc:1939] T 7863865c6741481082270bec883ed779 P 44628a963765451aa6ab3a7be9d9a881: Deleting consensus metadata
W20260809 01:59:17.528748 27201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:42397 (error 108)
I20260809 01:59:17.530586 27202 catalog_manager.cc:4841] TS 44628a963765451aa6ab3a7be9d9a881 (127.14.175.195:42497): tablet 7863865c6741481082270bec883ed779 (table test-table [id=4ecc37f3f28f4c64b8704c054b8fcd18]) successfully deleted
I20260809 01:59:17.530906 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 27449
I20260809 01:59:17.537233 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 01:59:17.536829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:42397 (local address 127.0.0.1:49120)
0809 01:59:17.537005 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 01:59:17.537122 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:42397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 01:59:17.537424 27201 catalog_manager.cc:4584] TS 16815a2f0fe74092b4a2c0cbbcd013d0 (127.14.175.193:42397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7863865c6741481082270bec883ed779: Network error: Client connection negotiation failed: client connection to 127.14.175.193:42397: connect: Connection refused (error 111)
Aug 09 01:59:17 dist-test-slave-2w3w krb5kdc[26689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240756, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:17.545225 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 27595
I20260809 01:59:17.555160 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 27183
I20260809 01:59:17.564424 15039 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 01:59:17.921967 15039 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 01:59:17.922118 15039 mini_ranger.cc:66] Stopping Ranger...
I20260809 01:59:18.266324 15039 mini_ranger.cc:68] Stopped Ranger
2026-08-09 01:59:18.266 UTC [26724] LOG: received smart shutdown request
2026-08-09 01:59:18.269 UTC [26724] LOG: background worker "logical replication launcher" (PID 26733) exited with exit code 1
2026-08-09 01:59:18.270 UTC [26728] LOG: shutting down
2026-08-09 01:59:18.425 UTC [26724] LOG: database system is shut down
2026-08-09T01:59:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46914 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 01:59:18 dist-test-slave-2w3w krb5kdc[27793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 01:59:18 dist-test-slave-2w3w krb5kdc[27793](info): set up 2 sockets
Aug 09 01:59:18 dist-test-slave-2w3w krb5kdc[27793](info): commencing operation
krb5kdc: starting...
W20260809 01:59:19.623935 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 01:59:19 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T01:59:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T01:59:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangeradmin_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangeradmin_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangerlookup_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangerlookup_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
I20260809 01:59:19.797529 15039 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXh4dFo/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/postgres -l logfile start
2026-08-09 01:59:22.185 UTC [27825] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 01:59:22.185 UTC [27825] LOG: listening on IPv4 address "127.14.175.212", port 43049
2026-08-09 01:59:22.189 UTC [27825] LOG: listening on Unix socket "/tmp/.s.PGSQL.43049"
2026-08-09 01:59:22.225 UTC [27828] LOG: database system was shut down at 2026-08-09 01:59:20 UTC
2026-08-09 01:59:22.230 UTC [27825] LOG: database system is ready to accept connections
I20260809 01:59:23.217293 15039 mini_postgres.cc:96] Postgres bound to 43049
2026-08-09 01:59:23.224 UTC [27836] FATAL: database "slave" does not exist
127.14.175.212:43049 - accepting connections
I20260809 01:59:23.225126 15039 mini_ranger.cc:161] Starting Ranger...
I20260809 01:59:23.240657 15039 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 01:59:23.699247 15039 mini_ranger.cc:87] Created ranger Postgres database
I20260809 01:59:23.699368 15039 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin
2026-08-09 01:59:23,987 [I] DB FLAVOR :POSTGRES
2026-08-09 01:59:23,988 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 01:59:23,988 [I] Checking connection..
2026-08-09 01:59:23,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 01:59:24,230 [I] Checking connection passed.
2026-08-09 01:59:24,230 [I] --------- Verifying version history table ---------
2026-08-09 01:59:24,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:59:24,483 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 01:59:24,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:59:24,746 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 01:59:24,746 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 01:59:24,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 01:59:25.002 UTC [27904] WARNING: there is no transaction in progress
2026-08-09 01:59:25,009 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 01:59:25,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 01:59:25,275 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 01:59:25,276 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 01:59:25,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 01:59:25,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 01:59:25,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-09 01:59:26,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 01:59:26,296 [I] Table x_portal_user does not exist in database ranger
2026-08-09 01:59:26,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 01:59:26,545 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 01:59:26,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 01:59:26,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 01:59:27,045 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 01:59:27,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 01:59:27.985 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.001 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.019 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.034 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.053 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.072 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.126 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.133 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.147 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.156 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.166 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.180 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.190 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.196 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.203 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28.209 UTC [28022] WARNING: there is no transaction in progress
2026-08-09 01:59:28,808 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 01:59:28,809 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 01:59:29,071 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 01:59:29,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 01:59:29,307 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 01:59:29,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 01:59:29,551 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 01:59:29,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 01:59:29,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 01:59:30,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-09 01:59:30,318 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 01:59:30,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 01:59:30,561 [I] DB_PATCHES have already been applied
I20260809 01:59:30.567636 15039 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXh4dFo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 01:59:30.567701 15039 mini_ranger.cc:193] Using host: 127.14.175.212
I20260809 01:59:30.571841 15039 mini_ranger.cc:227] Ranger admin URL: http://127.14.175.212:60891
Aug 09, 2026 1:59:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:59:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:59:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 1:59:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 1:59:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 1:59:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 1:59:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 01:59:31.773605 15039 mini_ranger.cc:160] Time spent starting Ranger: real 8.548s user 0.008s sys 0.004s
Aug 09, 2026 1:59:50 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 1:59:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 1:59:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 1:59:51 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 1:59:51 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 01:59:52.505455 15039 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangerkms_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/rangerkms_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/HTTP_127.14.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 01:59:52 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240792, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 01:59:52.590889 15039 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 01:59:52.601125 15039 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 01:59:53.473189 15039 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 01:59:53.473282 15039 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms
I20260809 01:59:53.473306 15039 mini_ranger_kms.cc:227] Using postgres at 127.14.175.212:43049
2026-08-09 01:59:53,676 [I] DB FLAVOR :POSTGRES
2026-08-09 01:59:53,676 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 01:59:53,677 [I] Checking connection
2026-08-09 01:59:53,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 01:59:53,925 [I] connection success
2026-08-09 01:59:53,926 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 01:59:53,926 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 01:59:53,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 01:59:54,161 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 01:59:54,161 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 01:59:54,161 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 01:59:54,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.175.212:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 01:59:54,441 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 01:59:54.910022 15039 mini_ranger_kms.cc:310] Created kms service
I20260809 01:59:55.101624 15039 mini_ranger_kms.cc:326] Created kudu user
I20260809 01:59:55.146021 15039 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 01:59:55 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240792, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 01:59:55.561892 15039 mini_ranger_kms.cc:384] Added ranger policy
I20260809 01:59:55.562170 15039 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXh4dFo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXh4dFo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 01:59:55.562202 15039 mini_ranger_kms.cc:240] Using host: 127.14.175.212
I20260809 01:59:55.566671 15039 mini_ranger_kms.cc:276] Ranger KMS PID: 28208
I20260809 01:59:55.566758 15039 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.175.212:40331
Aug 09, 2026 1:59:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:59:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:59:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 1:59:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 1:59:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 1:59:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 01:59:57 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786240797, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 01:59:57.917347 15039 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.326s user 0.019s sys 0.170s
I20260809 01:59:57.917491 15039 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 01:59:57.917570 15039 mini_ranger_kms.cc:401] 127.14.175.212:40331/kms/v1/keys
Aug 09 01:59:58 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240797, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
Aug 09 01:59:58 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240797, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.175.212@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
Aug 09 02:00:00 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:00:00.674072 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35377
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:35377
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:00.792912 28262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:00.793323 28262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:00.793396 28262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:00.797559 28262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:00.797612 28262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:00.797632 28262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:00.797690 28262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:00.797721 28262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:00.803829 28262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.175.212:40331/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:35377
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:00.804921 28262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:00.805976 28262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:00:00.814803 28262 server_base.cc:1034] running on GCE node
W20260809 02:00:00.814754 28269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:00.814762 28268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:00.814754 28271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:00.815596 28262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:00.816699 28262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:00.817909 28262 hybrid_clock.cc:648] HybridClock initialized: now 1786240800817886 us; error 45 us; skew 500 ppm
Aug 09 02:00:00 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240800, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:00.824158 28262 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:00.825137 28262 webserver.cc:460] Webserver started at http://127.14.175.254:35425/ using document root <none> and password file <none>
I20260809 02:00:00.825661 28262 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:00.825712 28262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:00.825884 28262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:00:00 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240800, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:00.883332 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e"
format_stamp: "Formatted at 2026-08-09 02:00:00 on dist-test-slave-2w3w"
server_key: "3e6544758a086a0aedc8901d981bdcb6"
server_key_iv: "1c9816623cf7e44d807c999f41fa63fe"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:00.884124 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e"
format_stamp: "Formatted at 2026-08-09 02:00:00 on dist-test-slave-2w3w"
server_key: "3e6544758a086a0aedc8901d981bdcb6"
server_key_iv: "1c9816623cf7e44d807c999f41fa63fe"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:00.889001 28262 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 02:00:00.906912 28279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:00.908697 28262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:00:00.908845 28262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e"
format_stamp: "Formatted at 2026-08-09 02:00:00 on dist-test-slave-2w3w"
server_key: "3e6544758a086a0aedc8901d981bdcb6"
server_key_iv: "1c9816623cf7e44d807c999f41fa63fe"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:00.908986 28262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:00.927778 28262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:00.930270 28262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:00.930500 28262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:00.937749 28262 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:35377
I20260809 02:00:00.937762 28332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:35377 every 8 connection(s)
I20260809 02:00:00.938704 28262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:00.941437 28333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:00.942880 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28262
I20260809 02:00:00.943060 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:00:00.943457 15039 external_mini_cluster.cc:1428] Setting key 144f6e5fa0224020c7e2ba37b231f69c
I20260809 02:00:00.947799 28333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Bootstrap starting.
I20260809 02:00:00.950278 28333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:00.951267 28333 log.cc:824] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:00:00 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:00.953243 28333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: No bootstrap required, opened a new log
I20260809 02:00:00.956465 28333 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:00.956712 28333 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:00.956821 28333 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d6d982b4ec423b9e8a3e6f50355a0e, State: Initialized, Role: FOLLOWER
I20260809 02:00:00.957261 28333 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:00.957399 28333 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:00.957500 28333 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:00.957633 28333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:00.957894 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:00.944940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54898 (local address 127.14.175.254:35377)
0809 02:00:00.945326 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:00.945349 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:00.945388 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:00:00.946013 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:00.946028 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:00.946335 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:00.946598 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:00.947567 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:00.948598 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:00.949804 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:00.950280 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:00.950482 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:00.953238 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:00.953243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:00.953255 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:00.953278 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:00.955049 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:00.955494 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:00.955499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:00.955505 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:00.955611 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:00.955913 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:00.955916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:00.955918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:00.956271 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:00.956486 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:00.956721 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 02:00:00.956996 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":129,"threads_started":1}
I20260809 02:00:00.958556 28333 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:00.958930 28333 leader_election.cc:302] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1d6d982b4ec423b9e8a3e6f50355a0e; no voters:
I20260809 02:00:00.959304 28333 leader_election.cc:288] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:00:00.959378 28338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:00.959594 28338 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 LEADER]: Becoming Leader. State: Replica: c1d6d982b4ec423b9e8a3e6f50355a0e, State: Running, Role: LEADER
I20260809 02:00:00.959926 28338 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:00.960628 28333 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:00.961191 28338 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1d6d982b4ec423b9e8a3e6f50355a0e. Latest consensus state: current_term: 1 leader_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } } }
I20260809 02:00:00.961390 28338 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:00.961585 28339 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } } }
I20260809 02:00:00.961750 28339 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:00.961820 28346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:00.964977 28346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:00.965448 28333 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:00:00.975277 28346 catalog_manager.cc:1347] Generated new cluster ID: cd616182bc4c448696cfd5fdd966e334
I20260809 02:00:00.975410 28346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:01.017568 28346 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:00:01.018636 28346 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:01.034106 28346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Generated new TSK 0
I20260809 02:00:01.034871 28346 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:00:01.729714 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:01.874591 28382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:01.874890 28382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:01.875037 28382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:01.879194 28382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:01.879266 28382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:01.879346 28382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:01.885407 28382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:01.886452 28382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:01.887579 28382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:01.897415 28391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:01.897526 28390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:01.897727 28382 server_base.cc:1034] running on GCE node
W20260809 02:00:01.897790 28394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:01.898315 28382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:01.899091 28382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:01.902392 28382 hybrid_clock.cc:648] HybridClock initialized: now 1786240801902358 us; error 42 us; skew 500 ppm
Aug 09 02:00:01 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240801, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:01.905622 28382 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:01.906497 28382 webserver.cc:460] Webserver started at http://127.14.175.193:34325/ using document root <none> and password file <none>
I20260809 02:00:01.907127 28382 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:01.907223 28382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:01.907459 28382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:00:01 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240801, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:01.924799 28382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "2d67e951867b43a592c7128e574d9ab5"
format_stamp: "Formatted at 2026-08-09 02:00:01 on dist-test-slave-2w3w"
server_key: "758e339935a6301e709860b3da8d51ad"
server_key_iv: "e1cbf3728d147828b61a303225f7e7b2"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:01.925591 28382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "2d67e951867b43a592c7128e574d9ab5"
format_stamp: "Formatted at 2026-08-09 02:00:01 on dist-test-slave-2w3w"
server_key: "758e339935a6301e709860b3da8d51ad"
server_key_iv: "e1cbf3728d147828b61a303225f7e7b2"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:01.932614 28382 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.004s
I20260809 02:00:01.960302 28404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:01.961957 28382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:00:01.962160 28382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "2d67e951867b43a592c7128e574d9ab5"
format_stamp: "Formatted at 2026-08-09 02:00:01 on dist-test-slave-2w3w"
server_key: "758e339935a6301e709860b3da8d51ad"
server_key_iv: "e1cbf3728d147828b61a303225f7e7b2"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:01.962378 28382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:01.980432 28382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:01.984140 28382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:01.984409 28382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:01.985209 28382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:01.986338 28382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:01.986451 28382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:01.986573 28382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:01.986658 28382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.000322 28382 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:40339
I20260809 02:00:02.000684 28525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:40339 every 8 connection(s)
I20260809 02:00:02.001633 28382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240801, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:02.011421 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28382
I20260809 02:00:02.011551 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:00:02.011931 15039 external_mini_cluster.cc:1428] Setting key 5fa419b31f8c1a345ab24a99f0a77b87
I20260809 02:00:02.016922 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.003675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38933 (local address 127.14.175.254:35377)
0809 02:00:02.003985 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:02.003995 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:02.004682 (+ 687us) server_negotiation.cc:407] Connection header received
0809 02:00:02.005672 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:02.005675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:02.005736 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:02.005852 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:02.006926 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.007539 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.008743 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.009050 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.009166 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.011917 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:02.011920 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:02.011923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:02.011954 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:02.014121 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.014923 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.014929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.014934 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.015056 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.015573 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.015579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.015584 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.015839 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:02.015918 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:02.016599 (+ 681us) server_negotiation.cc:299] Negotiation successful
0809 02:00:02.016723 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":114,"threads_started":1}
I20260809 02:00:02.017807 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.004092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.193:38933)
0809 02:00:02.004531 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:02.004584 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:02.005461 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:02.006026 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:02.006033 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:02.006303 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:02.006762 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.006775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.007676 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.007679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.008597 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.008606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.009207 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.009213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.009396 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.010052 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:02.010068 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:02.011710 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:02.014335 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.014345 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.014402 (+ 57us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.014798 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.015177 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.015182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.015187 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.015460 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.016012 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:02.016022 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:02.016360 (+ 338us) client_negotiation.cc:769] Sending connection context
0809 02:00:02.016560 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 02:00:02.016878 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":135,"threads_started":1}
I20260809 02:00:02.019155 28526 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:02.019397 28526 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:02.020012 28526 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:02.021626 28296 ts_manager.cc:194] Registered new tserver with Master: 2d67e951867b43a592c7128e574d9ab5 (127.14.175.193:40339)
I20260809 02:00:02.023286 28296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:38933
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:02.051225 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:02.210091 28533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:02.210456 28533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:02.210522 28533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:02.216648 28533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:02.216734 28533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:02.216825 28533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:02.224699 28533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:02.226035 28533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:02.227412 28533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:02.239732 28539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.239732 28542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.241856 28540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:02.242502 28533 server_base.cc:1034] running on GCE node
I20260809 02:00:02.243081 28533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:02.243819 28533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:02.251223 28533 hybrid_clock.cc:648] HybridClock initialized: now 1786240802251152 us; error 103 us; skew 500 ppm
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:02.254983 28533 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:02.256179 28533 webserver.cc:460] Webserver started at http://127.14.175.194:32827/ using document root <none> and password file <none>
I20260809 02:00:02.256935 28533 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:02.257081 28533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:02.257385 28533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:02.276912 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "31d61d7f1e7a472a8baef8bf35692104"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "beb7ede0a2570039c87b32226de90e9d"
server_key_iv: "298500f1ccfc88b8489ebd51b5cb8835"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.277743 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "31d61d7f1e7a472a8baef8bf35692104"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "beb7ede0a2570039c87b32226de90e9d"
server_key_iv: "298500f1ccfc88b8489ebd51b5cb8835"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.284365 28533 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260809 02:00:02.300117 28549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.301843 28533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:00:02.302048 28533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "31d61d7f1e7a472a8baef8bf35692104"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "beb7ede0a2570039c87b32226de90e9d"
server_key_iv: "298500f1ccfc88b8489ebd51b5cb8835"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.302273 28533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:02.351848 28533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:02.355576 28533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:02.355831 28533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:02.356585 28533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:02.357645 28533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:02.357740 28533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.357846 28533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:02.357904 28533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.368580 28533 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:40693
I20260809 02:00:02.369747 28533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:00:02.369959 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28533
I20260809 02:00:02.370093 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:00:02.370474 15039 external_mini_cluster.cc:1428] Setting key 949dc7ca887d2a13e251180847c324b7
I20260809 02:00:02.382889 28670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:40693 every 8 connection(s)
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:02.405336 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.386691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:39787 (local address 127.14.175.254:35377)
0809 02:00:02.386826 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:02.386856 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:02.391380 (+ 4524us) server_negotiation.cc:407] Connection header received
0809 02:00:02.392639 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:02.392643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:02.392703 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:02.392763 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:02.394506 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.395401 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.397221 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.397572 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.397655 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.400976 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:02.400980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:02.400983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:02.401012 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:02.402765 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.403426 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.403429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.403431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.403518 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.403935 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.403939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.403941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.404199 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:02.404288 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:02.405011 (+ 723us) server_negotiation.cc:299] Negotiation successful
0809 02:00:02.405157 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:00:02.407287 28674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.385546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.194:39787)
0809 02:00:02.391153 (+ 5607us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:02.391234 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:02.392356 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:02.393223 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:02.393233 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:02.393599 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:02.394314 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.394337 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.395589 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.395595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.397074 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.397086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.397890 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.397895 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.398096 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.398804 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:02.398839 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:02.400736 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:02.402919 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.402926 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.402942 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.403302 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.403625 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.403628 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.403630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.403806 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.404361 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:02.404367 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:02.404694 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 02:00:02.405811 (+ 1117us) client_negotiation.cc:240] Negotiation successful
0809 02:00:02.406178 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5309,"thread_start_us":169,"threads_started":1}
I20260809 02:00:02.408979 28671 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:02.409255 28671 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:02.409849 28671 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:02.411159 28296 ts_manager.cc:194] Registered new tserver with Master: 31d61d7f1e7a472a8baef8bf35692104 (127.14.175.194:40693)
I20260809 02:00:02.411934 28296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:39787
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:00:02.434149 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
W20260809 02:00:02.600301 28676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:02.600719 28676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:02.600826 28676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:02.606791 28676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:02.606936 28676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:02.607084 28676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:02.614763 28676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:02.616556 28676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:02.617877 28676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:02.630633 28684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.630627 28682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.631636 28681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:02.631956 28676 server_base.cc:1034] running on GCE node
I20260809 02:00:02.632534 28676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:02.633267 28676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:02.636520 28676 hybrid_clock.cc:648] HybridClock initialized: now 1786240802636442 us; error 85 us; skew 500 ppm
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:02.639977 28676 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:02.640978 28676 webserver.cc:460] Webserver started at http://127.14.175.195:39155/ using document root <none> and password file <none>
I20260809 02:00:02.641614 28676 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:02.641681 28676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:02.641886 28676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:02.657133 28676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "6451fe37ed9944b287ca17181a86b65e"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "736bb947146ae824396b258c9052241a"
server_key_iv: "544e733b82d99e5313538290f882f644"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.657840 28676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "6451fe37ed9944b287ca17181a86b65e"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "736bb947146ae824396b258c9052241a"
server_key_iv: "544e733b82d99e5313538290f882f644"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.663342 28676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 02:00:02.687352 28692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.689029 28676 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260809 02:00:02.689154 28676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "6451fe37ed9944b287ca17181a86b65e"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "736bb947146ae824396b258c9052241a"
server_key_iv: "544e733b82d99e5313538290f882f644"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:02.689309 28676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:02.716740 28676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:02.720163 28676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:02.720422 28676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:02.721151 28676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:02.722199 28676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:02.722317 28676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.722424 28676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:02.722486 28676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:02.733939 28676 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:44737
I20260809 02:00:02.737530 28676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:02.742524 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28676
I20260809 02:00:02.742647 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:00:02.742941 15039 external_mini_cluster.cc:1428] Setting key 5941936d3e40c20e13410fa6ba780e30
I20260809 02:00:02.739224 28813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:44737 every 8 connection(s)
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:02.761018 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.743337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:37921 (local address 127.14.175.254:35377)
0809 02:00:02.743720 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:02.743724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:02.746015 (+ 2291us) server_negotiation.cc:407] Connection header received
0809 02:00:02.747210 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:02.747214 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:02.747266 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:02.747330 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:02.749025 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.749797 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.751474 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.751791 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.751867 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.756935 (+ 5068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:02.756939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:02.756942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:02.756968 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:02.758705 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.759351 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.759355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.759356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.759445 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:02.759840 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:02.759843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:02.759845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:02.760041 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:02.760113 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:02.760751 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 02:00:02.760869 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290}
I20260809 02:00:02.762797 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:02.741340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.195:37921)
0809 02:00:02.745873 (+ 4533us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:02.745929 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:02.746953 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:02.747850 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:02.747860 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:02.748200 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:02.748845 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.748863 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.749941 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.749944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.751335 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:02.751347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:02.752059 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:02.752063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:02.752255 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:02.753035 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:02.753061 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:02.754995 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:02.758844 (+ 3849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.758850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.758866 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.759226 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.759555 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:02.759558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:02.759560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:02.759728 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:02.760172 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:02.760178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:02.760487 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 02:00:02.761469 (+ 982us) client_negotiation.cc:240] Negotiation successful
0809 02:00:02.761804 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4316,"thread_start_us":128,"threads_started":1}
I20260809 02:00:02.764227 28814 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:02.764460 28814 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:02.764978 28814 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:02.766067 28296 ts_manager.cc:194] Registered new tserver with Master: 6451fe37ed9944b287ca17181a86b65e (127.14.175.195:44737)
I20260809 02:00:02.766755 28296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:37921
I20260809 02:00:02.770424 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:02.771160 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28382
I20260809 02:00:02.782513 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28533
I20260809 02:00:02.793840 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28676
I20260809 02:00:02.813146 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28262
I20260809 02:00:02.822736 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35377
--webserver_interface=127.14.175.254
--webserver_port=35425
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:35377
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:02.934696 28817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:02.934989 28817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:02.935030 28817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:02.938989 28817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:02.939046 28817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:02.939066 28817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:02.939082 28817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:02.939136 28817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:02.944576 28817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:35377
--ranger_config_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=35425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:02.945533 28817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:02.946503 28817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:00:02.954896 28817 server_base.cc:1034] running on GCE node
W20260809 02:00:02.954897 28824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.955109 28823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:02.954892 28826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:02.955710 28817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:02.956790 28817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:02.957993 28817 hybrid_clock.cc:648] HybridClock initialized: now 1786240802957966 us; error 38 us; skew 500 ppm
Aug 09 02:00:02 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:02.960750 28817 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:02.961519 28817 webserver.cc:460] Webserver started at http://127.14.175.254:35425/ using document root <none> and password file <none>
I20260809 02:00:02.961987 28817 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:02.962052 28817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240802, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:03.042164 28817 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:00:03.044580 28834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.046355 28817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:00:03.046522 28817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e"
format_stamp: "Formatted at 2026-08-09 02:00:00 on dist-test-slave-2w3w"
server_key: "3e6544758a086a0aedc8901d981bdcb6"
server_key_iv: "1c9816623cf7e44d807c999f41fa63fe"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:03.047449 28817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:03.060365 28817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:03.063294 28817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:03.063493 28817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:03.070585 28817 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:35377
I20260809 02:00:03.070596 28888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:35377 every 8 connection(s)
I20260809 02:00:03.071667 28817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:03.071897 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28817
I20260809 02:00:03.072415 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:40339
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:35377
--webserver_port=34325
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:03.076190 28889 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:00:03.078776 28889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Bootstrap starting.
I20260809 02:00:03.101577 28889 log.cc:824] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:03.109766 28889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:03.110229 28889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Bootstrap complete.
I20260809 02:00:03.115712 28889 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:03.116194 28889 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d6d982b4ec423b9e8a3e6f50355a0e, State: Initialized, Role: FOLLOWER
I20260809 02:00:03.116748 28889 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:03.116899 28889 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:03.116986 28889 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:03.117102 28889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:00:03.119557 28889 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:03.119916 28889 leader_election.cc:302] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1d6d982b4ec423b9e8a3e6f50355a0e; no voters:
I20260809 02:00:03.120245 28889 leader_election.cc:288] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:00:03.120370 28893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:00:03.120652 28893 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [term 2 LEADER]: Becoming Leader. State: Replica: c1d6d982b4ec423b9e8a3e6f50355a0e, State: Running, Role: LEADER
I20260809 02:00:03.120945 28893 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } }
I20260809 02:00:03.121455 28889 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:03.121853 28895 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1d6d982b4ec423b9e8a3e6f50355a0e. Latest consensus state: current_term: 2 leader_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } } }
I20260809 02:00:03.121986 28895 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:03.122251 28894 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d6d982b4ec423b9e8a3e6f50355a0e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35377 } } }
I20260809 02:00:03.122329 28894 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:03.122411 28897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:03.125149 28897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:03.125648 28889 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:00:03.125788 28897 catalog_manager.cc:1259] Loaded cluster ID: cd616182bc4c448696cfd5fdd966e334
I20260809 02:00:03.125854 28897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:03.131397 28897 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:03.132257 28897 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Loaded TSK: 0
I20260809 02:00:03.133538 28897 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:00:03.229138 28891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:03.229523 28891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:03.229604 28891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:03.235565 28891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:03.235642 28891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:03.235731 28891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:03.243302 28891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:40339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=34325
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:03.244558 28891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:03.245959 28891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:03.258190 28929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:03.258196 28931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:03.258581 28928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:03.258981 28891 server_base.cc:1034] running on GCE node
I20260809 02:00:03.259426 28891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:03.260171 28891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:03.261369 28891 hybrid_clock.cc:648] HybridClock initialized: now 1786240803261351 us; error 35 us; skew 500 ppm
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:03.264878 28891 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:03.265875 28891 webserver.cc:460] Webserver started at http://127.14.175.193:34325/ using document root <none> and password file <none>
I20260809 02:00:03.266539 28891 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:03.266639 28891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:03.287406 28891 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:00:03.299962 28940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.301903 28891 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260809 02:00:03.302048 28891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "2d67e951867b43a592c7128e574d9ab5"
format_stamp: "Formatted at 2026-08-09 02:00:01 on dist-test-slave-2w3w"
server_key: "758e339935a6301e709860b3da8d51ad"
server_key_iv: "e1cbf3728d147828b61a303225f7e7b2"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:03.302790 28891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:03.327346 28891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:03.331024 28891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:03.331295 28891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:03.332037 28891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:03.333114 28891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:03.333225 28891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.333364 28891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:03.333464 28891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.344939 28891 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:40339
I20260809 02:00:03.346248 28891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:03.346210 29062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:40339 every 8 connection(s)
I20260809 02:00:03.353664 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 28891
I20260809 02:00:03.354146 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:40693
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:35377
--webserver_port=32827
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:03.366902 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.348788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.193:59265)
0809 02:00:03.349938 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:03.349998 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:03.351076 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:03.352522 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:03.352531 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:03.352960 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:03.353619 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.353642 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.355721 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.355724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.357094 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.357105 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.358329 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.358332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.358510 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.359244 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:03.359265 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:03.360989 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:03.363480 (+ 2491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.363485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.363498 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.363799 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.364199 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.364202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.364204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.364381 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.365199 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:03.365205 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:03.365473 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 02:00:03.365664 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 02:00:03.365966 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":132,"threads_started":1}
I20260809 02:00:03.368716 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.350246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:59265 (local address 127.14.175.254:35377)
0809 02:00:03.350920 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:03.350941 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:03.351010 (+ 69us) server_negotiation.cc:407] Connection header received
0809 02:00:03.351570 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:03.351585 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:03.352051 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:03.352423 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:03.353923 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.355558 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.357253 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.357967 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.358127 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.361193 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:03.361199 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:03.361214 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:03.361243 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:03.363350 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.363942 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.363947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.363953 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.364087 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.364498 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.364501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.364503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.365013 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:03.365142 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:03.367493 (+ 2351us) server_negotiation.cc:299] Negotiation successful
0809 02:00:03.367791 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":109,"threads_started":1}
I20260809 02:00:03.371784 29063 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:03.372076 29063 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.372574 29063 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
W20260809 02:00:03.374827 29063 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:35377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:00:03.375010 29063 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.375188 29063 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:03.376140 29063 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.376343 29063 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
W20260809 02:00:03.377342 29063 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:00:03.500180 29067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:03.500536 29067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:03.500608 29067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:03.505425 29067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:03.505482 29067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:03.505542 29067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:03.511610 29067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:40693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=32827
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:03.512820 29067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:03.514015 29067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:03.525923 29075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:03.526605 29067 server_base.cc:1034] running on GCE node
W20260809 02:00:03.526742 29073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:03.527185 29072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:03.527650 29067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:03.528414 29067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:03.529616 29067 hybrid_clock.cc:648] HybridClock initialized: now 1786240803529588 us; error 43 us; skew 500 ppm
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:03.532676 29067 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:03.533710 29067 webserver.cc:460] Webserver started at http://127.14.175.194:32827/ using document root <none> and password file <none>
I20260809 02:00:03.534390 29067 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:03.534482 29067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:03.560027 29067 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260809 02:00:03.563344 29083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.564908 29067 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:00:03.565091 29067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "31d61d7f1e7a472a8baef8bf35692104"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "beb7ede0a2570039c87b32226de90e9d"
server_key_iv: "298500f1ccfc88b8489ebd51b5cb8835"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:03.565871 29067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:03.598415 29067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:03.601708 29067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:03.601929 29067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:03.602586 29067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:03.603559 29067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:03.603631 29067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.603698 29067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:03.603746 29067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.614494 29067 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:40693
I20260809 02:00:03.619324 29206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:40693 every 8 connection(s)
I20260809 02:00:03.620596 29067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:00:03.629983 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29067
I20260809 02:00:03.630519 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.175.212:40331/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:44737
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:35377
--webserver_port=39155
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:03.641897 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.623828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:57617 (local address 127.14.175.254:35377)
0809 02:00:03.623981 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:03.623986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:03.625130 (+ 1144us) server_negotiation.cc:407] Connection header received
0809 02:00:03.626295 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:03.626298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:03.626358 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:03.626478 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:03.627808 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.628582 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.633040 (+ 4458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.633433 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.633526 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.636863 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:03.636867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:03.636871 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:03.636905 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:03.638872 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.639649 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.639656 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.639660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.639763 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.640231 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.640236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.640241 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.640538 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:03.640637 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:03.641441 (+ 804us) server_negotiation.cc:299] Negotiation successful
0809 02:00:03.641605 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:00:03.644143 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.624255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.194:57617)
0809 02:00:03.624978 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:03.625030 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:03.626071 (+ 1041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:03.626654 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:03.626661 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:03.626936 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:03.627649 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.627664 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.628747 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.628751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.632873 (+ 4122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.632887 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.633773 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.633777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.633987 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.634923 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:03.634944 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:03.636658 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:03.639048 (+ 2390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.639058 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.639081 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.639513 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.639887 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.639893 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.639898 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.640102 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.640717 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:03.640725 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:03.641095 (+ 370us) client_negotiation.cc:769] Sending connection context
0809 02:00:03.642481 (+ 1386us) client_negotiation.cc:240] Negotiation successful
0809 02:00:03.642881 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":156,"threads_started":1}
I20260809 02:00:03.645921 29207 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:03.646174 29207 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.646791 29207 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
W20260809 02:00:03.648569 29207 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:35377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:00:03.648705 29207 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.648885 29207 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:03.649765 29207 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.649922 29207 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
W20260809 02:00:03.650678 29207 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:00:03.768240 29210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:03.768564 29210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:03.768630 29210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:03.773535 29210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:03.773586 29210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:03.773643 29210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:03.779394 29210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.175.212:40331/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:44737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=39155
--tserver_master_addrs=127.14.175.254:35377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:03.780507 29210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:03.781613 29210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:03.794351 29216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:03.794862 29217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:03.795354 29219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:03.796362 29210 server_base.cc:1034] running on GCE node
I20260809 02:00:03.796785 29210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:03.797477 29210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:03.798681 29210 hybrid_clock.cc:648] HybridClock initialized: now 1786240803798643 us; error 43 us; skew 500 ppm
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:03.802489 29210 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:03.803658 29210 webserver.cc:460] Webserver started at http://127.14.175.195:39155/ using document root <none> and password file <none>
I20260809 02:00:03.804384 29210 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:03.804499 29210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:03.824632 29210 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260809 02:00:03.828987 29227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.830672 29210 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260809 02:00:03.830833 29210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "6451fe37ed9944b287ca17181a86b65e"
format_stamp: "Formatted at 2026-08-09 02:00:02 on dist-test-slave-2w3w"
server_key: "736bb947146ae824396b258c9052241a"
server_key_iv: "544e733b82d99e5313538290f882f644"
server_key_version: "kuduclusterkey@0"
I20260809 02:00:03.831650 29210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:03.861325 29210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:03.864868 29210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:03.865087 29210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:03.865830 29210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:03.866895 29210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:03.866991 29210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.867055 29210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:03.867096 29210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:03.879220 29210 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:44737
I20260809 02:00:03.880365 29210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:03.882359 29349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:44737 every 8 connection(s)
I20260809 02:00:03.883648 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29210
Aug 09 02:00:03 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240803, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:03.902011 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.885017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.14.175.254:35377)
0809 02:00:03.885231 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:03.885235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:03.885253 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:00:03.885303 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:03.885307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:03.885362 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:03.885471 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:03.887827 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.889627 (+ 1800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.891316 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.891847 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.892013 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.893788 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:03.893792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:03.893795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:03.893819 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:03.899906 (+ 6087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.900452 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.900455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.900457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.900581 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.900959 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.900977 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.900985 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.901236 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:03.901459 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:03.901672 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 02:00:03.901805 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260809 02:00:03.908499 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.888996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:45283 (local address 127.14.175.254:35377)
0809 02:00:03.889282 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:03.889290 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:03.889304 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:00:03.891207 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:03.891210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:03.891262 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:03.891350 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:03.895358 (+ 4008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.896177 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.897902 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.898257 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.898367 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.903086 (+ 4719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:03.903090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:03.903093 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:03.903118 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:03.905938 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.906586 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.906590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.906591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.906685 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:03.907099 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:03.907102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:03.907104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:03.907323 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:03.907413 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:03.908128 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 02:00:03.908276 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":220,"thread_start_us":103,"threads_started":1}
I20260809 02:00:03.909756 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:03.887964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:35377 (local address 127.14.175.195:45283)
0809 02:00:03.888506 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:03.888566 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:03.889649 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:03.891665 (+ 2016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:03.891676 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:03.893915 (+ 2239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:03.895181 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.895204 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.896333 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.896336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.897748 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:03.897760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:03.898453 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:03.898459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:03.898713 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:03.899560 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:03.899584 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:03.902394 (+ 2810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:03.906078 (+ 3684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.906085 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.906102 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.906457 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.906775 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:03.906778 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:03.906780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:03.906983 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:03.907470 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:03.907477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:03.907811 (+ 334us) client_negotiation.cc:769] Sending connection context
0809 02:00:03.908033 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 02:00:03.908389 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":155,"threads_started":1}
I20260809 02:00:03.911258 29350 heartbeater.cc:347] Connected to a master server at 127.14.175.254:35377
I20260809 02:00:03.911540 29350 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:03.912108 29350 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:03.913609 28851 ts_manager.cc:194] Registered new tserver with Master: 6451fe37ed9944b287ca17181a86b65e (127.14.175.195:44737)
I20260809 02:00:03.915342 28851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:45283
Aug 09 02:00:04 dist-test-slave-2w3w krb5kdc[27793](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786240804, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:04.377611 29063 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:04.377897 29063 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:04.378623 28851 ts_manager.cc:194] Registered new tserver with Master: 2d67e951867b43a592c7128e574d9ab5 (127.14.175.193:40339)
I20260809 02:00:04.379383 28851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:59265
Aug 09 02:00:04 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240804, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
I20260809 02:00:04.650995 29207 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:04.651307 29207 heartbeater.cc:511] Master 127.14.175.254:35377 requested a full tablet report, sending...
I20260809 02:00:04.652149 28851 ts_manager.cc:194] Registered new tserver with Master: 31d61d7f1e7a472a8baef8bf35692104 (127.14.175.194:40693)
I20260809 02:00:04.652992 28851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:57617
I20260809 02:00:04.658337 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:04.671438 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.660556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54920 (local address 127.14.175.254:35377)
0809 02:00:04.661203 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.661207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.661416 (+ 209us) server_negotiation.cc:407] Connection header received
0809 02:00:04.661587 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.661589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.661636 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.661691 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:04.662653 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.663432 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.664590 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.664947 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.665039 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.666820 (+ 1781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:04.666823 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:04.666826 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:04.666859 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:04.668730 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:04.669353 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:04.669357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:04.669358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:04.669452 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:04.670147 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:04.670150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:04.670152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:04.670351 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:04.670450 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.671115 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.671257 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":94,"threads_started":1}
I20260809 02:00:04.676143 28851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:00:04.680923 28851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:00:04.706144 29380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.696558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40693 (local address 127.0.0.1:38906)
0809 02:00:04.698799 (+ 2241us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.698881 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.699038 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.699801 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:04.699819 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:04.699846 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:04.699981 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.699987 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.701435 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.701438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.703958 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.703973 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.705501 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.705508 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.705638 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.705684 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 02:00:04.705817 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 02:00:04.705966 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2078,"mutex_wait_us":3,"thread_start_us":109,"threads_started":1}
I20260809 02:00:04.706764 29383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.697704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38906 (local address 127.14.175.194:40693)
0809 02:00:04.698062 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.698069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.699183 (+ 1114us) server_negotiation.cc:407] Connection header received
0809 02:00:04.699266 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.699271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.699481 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.699620 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:04.700123 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.701286 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.704132 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.705120 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.705264 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.705424 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.706513 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.706620 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":122,"threads_started":1}
I20260809 02:00:04.710053 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.696740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:40339 (local address 127.0.0.1:36760)
0809 02:00:04.700182 (+ 3442us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.700194 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.700264 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.701065 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:04.701067 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:04.701084 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:04.701165 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.701172 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.702616 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.702620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.706254 (+ 3634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.706264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.709580 (+ 3316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.709583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.709658 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.709677 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:00:04.709862 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 02:00:04.709929 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3385,"mutex_wait_us":2459,"thread_start_us":110,"threads_started":1}
I20260809 02:00:04.710477 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.697353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.14.175.193:40339)
0809 02:00:04.698566 (+ 1213us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.698572 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.700441 (+ 1869us) server_negotiation.cc:407] Connection header received
0809 02:00:04.700625 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.700630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.700797 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.700931 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:04.701288 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.702491 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.706382 (+ 3891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.707264 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.708168 (+ 904us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.708288 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.710246 (+ 1958us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.710347 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1116,"thread_start_us":86,"threads_started":1}
I20260809 02:00:04.710531 29133 tablet_service.cc:1467] Processing CreateTablet for tablet f073633932a2402b954fe221ca7b0982 (DEFAULT_TABLE table=test-table [id=68a1a01dc3f7463a8184da00a564c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:04.711835 29133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f073633932a2402b954fe221ca7b0982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:04.712904 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.697300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:44737 (local address 127.0.0.1:54070)
0809 02:00:04.702917 (+ 5617us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.702930 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.703050 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.704388 (+ 1338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:04.704391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:04.704407 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:04.704481 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.704486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.708346 (+ 3860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.708349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.709452 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.709463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.712492 (+ 3029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.712495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.712585 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.712607 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:00:04.712693 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:00:04.712754 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5561,"thread_start_us":103,"threads_started":1}
I20260809 02:00:04.713409 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.698053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54070 (local address 127.14.175.195:44737)
0809 02:00:04.699060 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.699076 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.703144 (+ 4068us) server_negotiation.cc:407] Connection header received
0809 02:00:04.703339 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.703345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.704117 (+ 772us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.704252 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:04.704596 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.705662 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.711335 (+ 5673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.712155 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.712306 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.712425 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.713167 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.713268 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":99,"threads_started":1}
I20260809 02:00:04.713258 28983 tablet_service.cc:1467] Processing CreateTablet for tablet f073633932a2402b954fe221ca7b0982 (DEFAULT_TABLE table=test-table [id=68a1a01dc3f7463a8184da00a564c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:04.714273 28983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f073633932a2402b954fe221ca7b0982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:04.716152 29276 tablet_service.cc:1467] Processing CreateTablet for tablet f073633932a2402b954fe221ca7b0982 (DEFAULT_TABLE table=test-table [id=68a1a01dc3f7463a8184da00a564c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:04.717118 29276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f073633932a2402b954fe221ca7b0982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:04.723855 29386 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Bootstrap starting.
I20260809 02:00:04.726482 29386 tablet_bootstrap.cc:654] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:04.727422 29386 log.cc:824] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:04.728082 29385 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Bootstrap starting.
I20260809 02:00:04.730273 29385 tablet_bootstrap.cc:654] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:04.731101 29385 log.cc:824] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:04.731513 29388 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Bootstrap starting.
I20260809 02:00:04.734396 29388 tablet_bootstrap.cc:654] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:04.734424 29386 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: No bootstrap required, opened a new log
I20260809 02:00:04.734714 29386 ts_tablet_manager.cc:1397] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260809 02:00:04.735322 29388 log.cc:824] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:04.738685 29386 raft_consensus.cc:348] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.738965 29386 raft_consensus.cc:374] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:04.739038 29386 raft_consensus.cc:729] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d67e951867b43a592c7128e574d9ab5, State: Initialized, Role: FOLLOWER
I20260809 02:00:04.739522 29386 consensus_queue.cc:260] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.740180 29063 heartbeater.cc:503] Master 127.14.175.254:35377 was elected leader, sending a full tablet report...
I20260809 02:00:04.744200 29385 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: No bootstrap required, opened a new log
I20260809 02:00:04.744436 29385 ts_tablet_manager.cc:1397] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260809 02:00:04.747640 29386 ts_tablet_manager.cc:1428] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Time spent starting tablet: real 0.013s user 0.001s sys 0.004s
I20260809 02:00:04.747865 29385 raft_consensus.cc:348] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.748157 29385 raft_consensus.cc:374] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:04.748214 29385 raft_consensus.cc:729] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d61d7f1e7a472a8baef8bf35692104, State: Initialized, Role: FOLLOWER
I20260809 02:00:04.749037 29388 tablet_bootstrap.cc:492] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: No bootstrap required, opened a new log
I20260809 02:00:04.749271 29388 ts_tablet_manager.cc:1397] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260809 02:00:04.749811 29385 consensus_queue.cc:260] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.751747 29385 ts_tablet_manager.cc:1428] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:00:04.752102 29207 heartbeater.cc:503] Master 127.14.175.254:35377 was elected leader, sending a full tablet report...
I20260809 02:00:04.753986 29388 raft_consensus.cc:348] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.754271 29388 raft_consensus.cc:374] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:04.754356 29388 raft_consensus.cc:729] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6451fe37ed9944b287ca17181a86b65e, State: Initialized, Role: FOLLOWER
I20260809 02:00:04.754885 29388 consensus_queue.cc:260] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.755944 29388 ts_tablet_manager.cc:1428] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:00:04.756319 29350 heartbeater.cc:503] Master 127.14.175.254:35377 was elected leader, sending a full tablet report...
W20260809 02:00:04.849421 29064 tablet.cc:2369] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:04.850347 29394 raft_consensus.cc:482] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:04.850556 29394 raft_consensus.cc:504] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.852520 29394 leader_election.cc:288] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31d61d7f1e7a472a8baef8bf35692104 (127.14.175.194:40693), 2d67e951867b43a592c7128e574d9ab5 (127.14.175.193:40339)
I20260809 02:00:04.857553 29383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.852438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33167 (local address 127.14.175.194:40693)
0809 02:00:04.852570 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.852575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.852876 (+ 301us) server_negotiation.cc:407] Connection header received
0809 02:00:04.853101 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.853104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.853153 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.853200 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:04.853648 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.854431 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.856113 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.856760 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.856855 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.856913 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.857311 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.857409 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:00:04.857955 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.852162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40693 (local address 127.14.175.195:33167)
0809 02:00:04.852776 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.852792 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.852961 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.853347 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:04.853350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:04.853367 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:04.853512 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.853518 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.854576 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.854580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.855958 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.855971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.857012 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.857016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.857165 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.857192 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:00:04.857687 (+ 495us) client_negotiation.cc:240] Negotiation successful
0809 02:00:04.857766 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":34,"thread_start_us":105,"threads_started":1}
I20260809 02:00:04.858695 29141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f073633932a2402b954fe221ca7b0982" candidate_uuid: "6451fe37ed9944b287ca17181a86b65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d61d7f1e7a472a8baef8bf35692104" is_pre_election: true
I20260809 02:00:04.859043 29396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.852827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:40339 (local address 127.14.175.195:57229)
0809 02:00:04.854507 (+ 1680us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.854520 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.854664 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.855052 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:04.855054 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:04.855071 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:04.855193 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.855198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.856194 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.856197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.857424 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:04.857435 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.858533 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.858536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:04.858671 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.858697 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:00:04.858801 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:00:04.858870 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1621,"mutex_wait_us":13,"thread_start_us":100,"threads_started":1}
I20260809 02:00:04.859061 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.853326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:57229 (local address 127.14.175.193:40339)
0809 02:00:04.853463 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.853467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.854592 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 02:00:04.854793 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.854796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.854858 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.854904 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:04.855332 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.856057 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.857570 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.858166 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.858255 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.858332 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.858834 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.858913 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 02:00:04.859079 29141 raft_consensus.cc:2454] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6451fe37ed9944b287ca17181a86b65e in term 0.
I20260809 02:00:04.859556 29230 leader_election.cc:302] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d61d7f1e7a472a8baef8bf35692104, 6451fe37ed9944b287ca17181a86b65e; no voters:
I20260809 02:00:04.859709 28995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f073633932a2402b954fe221ca7b0982" candidate_uuid: "6451fe37ed9944b287ca17181a86b65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d67e951867b43a592c7128e574d9ab5" is_pre_election: true
I20260809 02:00:04.859858 29394 raft_consensus.cc:2781] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:04.859929 29394 raft_consensus.cc:482] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:04.859966 29394 raft_consensus.cc:3037] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:04.859959 28995 raft_consensus.cc:2454] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6451fe37ed9944b287ca17181a86b65e in term 0.
I20260809 02:00:04.861393 29394 raft_consensus.cc:504] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.861773 29394 leader_election.cc:288] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [CANDIDATE]: Term 1 election: Requested vote from peers 31d61d7f1e7a472a8baef8bf35692104 (127.14.175.194:40693), 2d67e951867b43a592c7128e574d9ab5 (127.14.175.193:40339)
I20260809 02:00:04.862068 29141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f073633932a2402b954fe221ca7b0982" candidate_uuid: "6451fe37ed9944b287ca17181a86b65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d61d7f1e7a472a8baef8bf35692104"
I20260809 02:00:04.862185 29141 raft_consensus.cc:3037] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:04.862285 28995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f073633932a2402b954fe221ca7b0982" candidate_uuid: "6451fe37ed9944b287ca17181a86b65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d67e951867b43a592c7128e574d9ab5"
I20260809 02:00:04.862390 28995 raft_consensus.cc:3037] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:04.863498 29141 raft_consensus.cc:2454] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6451fe37ed9944b287ca17181a86b65e in term 1.
I20260809 02:00:04.863690 28995 raft_consensus.cc:2454] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6451fe37ed9944b287ca17181a86b65e in term 1.
I20260809 02:00:04.863806 29230 leader_election.cc:302] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d61d7f1e7a472a8baef8bf35692104, 6451fe37ed9944b287ca17181a86b65e; no voters:
I20260809 02:00:04.863991 29394 raft_consensus.cc:2781] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:04.864200 29394 raft_consensus.cc:686] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 1 LEADER]: Becoming Leader. State: Replica: 6451fe37ed9944b287ca17181a86b65e, State: Running, Role: LEADER
I20260809 02:00:04.864530 29394 consensus_queue.cc:237] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } }
I20260809 02:00:04.868045 28850 catalog_manager.cc:5495] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6451fe37ed9944b287ca17181a86b65e (127.14.175.195). New cstate: current_term: 1 leader_uuid: "6451fe37ed9944b287ca17181a86b65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6451fe37ed9944b287ca17181a86b65e" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260809 02:00:04.872584 29208 tablet.cc:2369] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:00:04.884277 29351 tablet.cc:2369] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:04.900300 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.896405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.14.175.195:44737)
0809 02:00:04.896538 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:04.896544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:04.896556 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:00:04.896626 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:04.896628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:04.896674 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:04.896797 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:04.897092 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.897794 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.898680 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:04.899032 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:04.899140 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:04.899510 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:04.899906 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:04.900067 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:04.900105 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 02:00:04.900160 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:00:04.907027 29141 raft_consensus.cc:1261] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 1 FOLLOWER]: Refusing update from remote peer 6451fe37ed9944b287ca17181a86b65e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:04.907027 28995 raft_consensus.cc:1261] T f073633932a2402b954fe221ca7b0982 P 2d67e951867b43a592c7128e574d9ab5 [term 1 FOLLOWER]: Refusing update from remote peer 6451fe37ed9944b287ca17181a86b65e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:04.908038 29397 consensus_queue.cc:1035] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d61d7f1e7a472a8baef8bf35692104" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:04.908488 29397 consensus_queue.cc:1035] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d67e951867b43a592c7128e574d9ab5" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:04.921684 29400 mvcc.cc:205] Tried to move back new op lower bound from 7316442336890507264 to 7316442336728170496. Current Snapshot: MvccSnapshot[applied={T|T < 7316442336890507264}]
I20260809 02:00:04.923746 29402 mvcc.cc:205] Tried to move back new op lower bound from 7316442336890507264 to 7316442336728170496. Current Snapshot: MvccSnapshot[applied={T|T < 7316442336890507264}]
I20260809 02:00:04.926813 29401 mvcc.cc:205] Tried to move back new op lower bound from 7316442336890507264 to 7316442336728170496. Current Snapshot: MvccSnapshot[applied={T|T < 7316442336890507264}]
I20260809 02:00:04.933909 28850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:04.934082 28850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:04.937155 28850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1d6d982b4ec423b9e8a3e6f50355a0e: Sending DeleteTablet for 3 replicas of tablet f073633932a2402b954fe221ca7b0982
I20260809 02:00:04.938303 29133 tablet_service.cc:1514] Processing DeleteTablet for tablet f073633932a2402b954fe221ca7b0982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:04 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:38906
I20260809 02:00:04.939075 29276 tablet_service.cc:1514] Processing DeleteTablet for tablet f073633932a2402b954fe221ca7b0982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:04 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:54070
I20260809 02:00:04.940313 28983 tablet_service.cc:1514] Processing DeleteTablet for tablet f073633932a2402b954fe221ca7b0982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:04 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:36760
I20260809 02:00:04.941537 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28891
W20260809 02:00:04.954391 28836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:40339 (error 108)
I20260809 02:00:04.955474 29412 tablet_replica.cc:330] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: stopping tablet replica
I20260809 02:00:04.955842 29412 raft_consensus.cc:2229] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:00:04.956336 29412 raft_consensus.cc:2258] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:04.956776 29411 tablet_replica.cc:330] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: stopping tablet replica
I20260809 02:00:04.957086 29411 raft_consensus.cc:2229] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:04.957441 29411 raft_consensus.cc:2258] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:04.961251 29412 ts_tablet_manager.cc:1905] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:04.961841 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:04.961463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:40339 (local address 127.0.0.1:36766)
0809 02:00:04.961660 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.961737 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:40339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 02:00:04.961971 29411 ts_tablet_manager.cc:1905] T f073633932a2402b954fe221ca7b0982 P 31d61d7f1e7a472a8baef8bf35692104: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:00:04.962291 28836 catalog_manager.cc:4584] TS 2d67e951867b43a592c7128e574d9ab5 (127.14.175.193:40339): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f073633932a2402b954fe221ca7b0982: Network error: Client connection negotiation failed: client connection to 127.14.175.193:40339: connect: Connection refused (error 111)
I20260809 02:00:04.962705 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29067
I20260809 02:00:04.964205 29412 ts_tablet_manager.cc:1918] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:04.964296 29412 log.cc:1196] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/f073633932a2402b954fe221ca7b0982
I20260809 02:00:04.964623 29412 ts_tablet_manager.cc:1939] T f073633932a2402b954fe221ca7b0982 P 6451fe37ed9944b287ca17181a86b65e: Deleting consensus metadata
I20260809 02:00:04.968798 28837 catalog_manager.cc:4841] TS 6451fe37ed9944b287ca17181a86b65e (127.14.175.195:44737): tablet f073633932a2402b954fe221ca7b0982 (table test-table [id=68a1a01dc3f7463a8184da00a564c7cf]) successfully deleted
Aug 09 02:00:04 dist-test-slave-2w3w krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240804, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for HTTP/127.14.175.212@KRBTEST.COM
W20260809 02:00:04.977581 29379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:00:04.976973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40693 (local address 127.0.0.1:38916)
0809 02:00:04.977157 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:04.977171 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:04.977263 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:04.977456 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.194:40693: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 02:00:04.978387 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29210
I20260809 02:00:04.988297 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 28817
I20260809 02:00:04.999217 15039 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:00:05.353943 15039 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:00:05.354053 15039 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:00:05.698817 15039 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:00:05.699 UTC [27825] LOG: received smart shutdown request
2026-08-09 02:00:05.703 UTC [27825] LOG: background worker "logical replication launcher" (PID 27834) exited with exit code 1
2026-08-09 02:00:05.704 UTC [27829] LOG: shutting down
2026-08-09 02:00:05.860 UTC [27825] LOG: database system is shut down
2026-08-09T02:00:05Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47443 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:00:06 dist-test-slave-2w3w krb5kdc[29425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:00:06 dist-test-slave-2w3w krb5kdc[29425](info): set up 2 sockets
Aug 09 02:00:06 dist-test-slave-2w3w krb5kdc[29425](info): commencing operation
krb5kdc: starting...
W20260809 02:00:07.080789 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:00:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:00:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:00:07.204010 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40685
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:07.314309 29438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:07.314592 29438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:07.314666 29438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:07.318650 29438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:07.318733 29438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:07.318771 29438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:07.318830 29438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:07.318871 29438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:07.324811 29438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:07.325785 29438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:07.326742 29438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:07.334945 29446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:07.335141 29438 server_base.cc:1034] running on GCE node
W20260809 02:00:07.335021 29445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:07.335021 29448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:07.335781 29438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:07.336756 29438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:07.337950 29438 hybrid_clock.cc:648] HybridClock initialized: now 1786240807337925 us; error 46 us; skew 500 ppm
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:07.340771 29438 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:07.341562 29438 webserver.cc:460] Webserver started at http://127.14.175.254:44841/ using document root <none> and password file <none>
I20260809 02:00:07.342087 29438 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:07.342185 29438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:07.342404 29438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:07.344794 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "156af933921e4a61b041718d17a7042f"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "4041a9de036e1a95f5899b29adf6abaf"
server_key_iv: "d31cc9c54ad42792694afea8ca4f8f34"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.345352 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "156af933921e4a61b041718d17a7042f"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "4041a9de036e1a95f5899b29adf6abaf"
server_key_iv: "d31cc9c54ad42792694afea8ca4f8f34"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.348873 29438 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:00:07.351197 29455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:07.352300 29438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:07.352437 29438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "156af933921e4a61b041718d17a7042f"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "4041a9de036e1a95f5899b29adf6abaf"
server_key_iv: "d31cc9c54ad42792694afea8ca4f8f34"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.352545 29438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:07.365947 29438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:07.368564 29438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:07.368753 29438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:07.375465 29438 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40685
I20260809 02:00:07.375753 29512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40685 every 8 connection(s)
I20260809 02:00:07.376374 29438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:07.378903 29513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:07.380045 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29438
I20260809 02:00:07.380219 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:00:07.380529 15039 external_mini_cluster.cc:1428] Setting key 6a6b83f4294430bfdfa3b10387dc8185
I20260809 02:00:07.382862 29513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.253@KRBTEST.COM" created.
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:07.399318 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.385487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58836 (local address 127.14.175.254:40685)
0809 02:00:07.386025 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.386042 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.386217 (+ 175us) server_negotiation.cc:407] Connection header received
0809 02:00:07.387743 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.387748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.387913 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.388057 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.389155 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.390056 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.391167 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.391533 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.391659 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.394380 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.394389 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.394406 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.394437 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.396137 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.396627 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.396635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.396636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.396740 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.397066 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.397069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.397071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.397508 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.397644 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.398025 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.398267 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":423,"spinlock_wait_cycles":50048,"thread_start_us":163,"threads_started":1}
I20260809 02:00:07.399318 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.385487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40685 (local address 127.0.0.1:58836)
0809 02:00:07.386045 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.386101 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.387427 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.388121 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.388126 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.388625 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.388990 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.389013 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.390186 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.390192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.391052 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.391061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.391672 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.391674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.391769 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.392362 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.392379 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.394217 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.396253 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.396263 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.396273 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.396512 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.396846 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.396848 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.396850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.396965 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.397629 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.397634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.397774 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.397944 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.398322 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":114,"thread_start_us":152,"threads_started":1}
I20260809 02:00:07.401895 29513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:00:07.402602 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.402330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57704)
0809 02:00:07.402429 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.402531 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:00:07.402894 29459 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
I20260809 02:00:07.403807 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.403605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57714)
0809 02:00:07.403708 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.403753 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:00:07.403954 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:38073: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
I20260809 02:00:07.409529 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:38073
--webserver_interface=127.14.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:07.453301 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } attempt: 1
I20260809 02:00:07.454276 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.453919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57720)
0809 02:00:07.454139 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.454201 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 02:00:07.455081 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.454799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57728)
0809 02:00:07.454912 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.455011 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:00:07.455210 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:38073: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
W20260809 02:00:07.519482 29520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:07.519759 29520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:07.519855 29520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:00:07.523365 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } attempt: 2
I20260809 02:00:07.524209 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.523918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57730)
0809 02:00:07.524064 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.524136 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 02:00:07.524441 29520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:07.524524 29520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:07.524571 29520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:07.524606 29520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:07.524629 29520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:07.524988 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.524781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57736)
0809 02:00:07.524890 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.524937 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:00:07.525194 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:38073: Network error: Client connection negotiation failed: client connection to 127.14.175.253:38073: connect: Connection refused (error 111)
I20260809 02:00:07.529955 29520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:38073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:07.530910 29520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:07.531955 29520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:07.540093 29526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:07.540139 29525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:07.540205 29520 server_base.cc:1034] running on GCE node
W20260809 02:00:07.540215 29528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:07.540905 29520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:07.541944 29520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:07.543090 29520 hybrid_clock.cc:648] HybridClock initialized: now 1786240807543075 us; error 30 us; skew 500 ppm
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:07.545917 29520 init.cc:377] Logged in from keytab as kudu/127.14.175.253@KRBTEST.COM (short username kudu)
I20260809 02:00:07.546732 29520 webserver.cc:460] Webserver started at http://127.14.175.253:43957/ using document root <none> and password file <none>
I20260809 02:00:07.547338 29520 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:07.547433 29520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:07.547669 29520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:07.549624 29520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data/instance:
uuid: "7582355340044d85babaac88f7888634"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "00ecea0cf096c0731ae68dcac8d2212c"
server_key_iv: "bcc67e962901f4e6dd4df243c7c258c3"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.550181 29520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal/instance:
uuid: "7582355340044d85babaac88f7888634"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "00ecea0cf096c0731ae68dcac8d2212c"
server_key_iv: "bcc67e962901f4e6dd4df243c7c258c3"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.553809 29520 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:00:07.556309 29536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:07.557456 29520 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:07.557603 29520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "7582355340044d85babaac88f7888634"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "00ecea0cf096c0731ae68dcac8d2212c"
server_key_iv: "bcc67e962901f4e6dd4df243c7c258c3"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.557716 29520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:07.571385 29520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:07.574579 29520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:07.574819 29520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:07.582008 29520 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.253:38073
I20260809 02:00:07.582048 29594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.253:38073 every 8 connection(s)
I20260809 02:00:07.583073 29520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
I20260809 02:00:07.585865 29595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:07.586527 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29520
I20260809 02:00:07.586699 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-1/wal/instance
I20260809 02:00:07.587102 15039 external_mini_cluster.cc:1428] Setting key 2ac6c026dabcea5930cca7e0e2f80b06
I20260809 02:00:07.590088 29595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.252@KRBTEST.COM" created.
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:07.605077 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.592409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58846 (local address 127.14.175.254:40685)
0809 02:00:07.592575 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.592580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.593412 (+ 832us) server_negotiation.cc:407] Connection header received
0809 02:00:07.594305 (+ 893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.594309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.594380 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.594492 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.595847 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.596725 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.597890 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.598130 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.598225 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.601228 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.601231 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.601234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.601267 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.602823 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.603500 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.603504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.603506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.603589 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.603964 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.603967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.603969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.604152 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.604263 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.604766 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.604893 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:00:07.605818 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.592756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40685 (local address 127.0.0.1:58846)
0809 02:00:07.593214 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.593263 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.594087 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.594746 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.594753 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.595204 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.595680 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.595692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.596859 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.596862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.597752 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.597761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.598273 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.598276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.598414 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.599079 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.599096 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.601060 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.602951 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.602957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.602991 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.603388 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.603689 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.603693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.603695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.603854 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.604263 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.604271 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.604512 (+ 241us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.604693 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.605009 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":122,"threads_started":1}
I20260809 02:00:07.607244 29595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:00:07.614487 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:34223
--webserver_interface=127.14.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:07.616380 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } attempt: 3
I20260809 02:00:07.617784 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.607837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57740)
0809 02:00:07.607962 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.607977 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.608051 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.608683 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.608686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.608845 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.608929 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.608934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.609973 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.609976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.610830 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.610840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.611623 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.611627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.611758 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.612349 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.612364 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.613811 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.615852 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.615859 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.615865 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.616166 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.616579 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.616583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.616586 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.616677 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.617256 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.617262 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.617364 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.617434 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.617599 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:00:07.618657 29600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.607969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57740 (local address 127.14.175.253:38073)
0809 02:00:07.608292 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.608301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.608319 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:00:07.608351 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.608355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.608487 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.608601 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.609061 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.609840 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.610951 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.611514 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.611604 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.613952 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.613961 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.613971 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.613991 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.615727 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.616304 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.616311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.616315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.616418 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.616790 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.616793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.616795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.617129 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.618007 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.618124 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.618344 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":243,"thread_start_us":156,"threads_started":1}
I20260809 02:00:07.620769 29595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:00:07.621647 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.621365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:33992)
0809 02:00:07.621494 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.621577 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 02:00:07.622609 29540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:00:07.623677 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.623398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:33994)
0809 02:00:07.623528 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.623596 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:00:07.623879 29595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.626883 29602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.616961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57750 (local address 127.14.175.253:38073)
0809 02:00:07.617266 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.617274 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.617291 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:00:07.617328 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.617333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.617376 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.617475 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.618140 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.618652 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.620351 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.620824 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.621001 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.623459 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.623463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.623465 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.623489 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.625104 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.625672 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.625674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.625676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.625746 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.626086 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.626088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.626089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.626239 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.626313 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.626685 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.626771 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":236,"thread_start_us":108,"threads_started":1}
I20260809 02:00:07.627115 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.616880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57750)
0809 02:00:07.617072 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.617088 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.617177 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.617527 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.617530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.617716 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.617863 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.617873 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.618909 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.618913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.620211 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.620222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.620995 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.620999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.621116 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.621601 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.621619 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.623271 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.625230 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.625237 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.625241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.625563 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.625852 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.625858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.625863 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.625979 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.626350 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.626357 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.626494 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.626644 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.626817 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 02:00:07.627867 29513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:00:07.628626 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.628304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:33998)
0809 02:00:07.628456 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.628530 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 02:00:07.629397 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.629111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34004)
0809 02:00:07.629282 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.629337 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260809 02:00:07.629566 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.660768 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 1
I20260809 02:00:07.661571 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.661255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34010)
0809 02:00:07.661426 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.661491 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 02:00:07.662346 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.662082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34014)
0809 02:00:07.662192 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.662251 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:00:07.662525 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.673151 29595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 1
I20260809 02:00:07.673880 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.673626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34028)
0809 02:00:07.673758 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.673812 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 02:00:07.674613 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.674428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34042)
0809 02:00:07.674522 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.674564 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 02:00:07.674822 29595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.741452 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 2
I20260809 02:00:07.742273 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.741946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34050)
0809 02:00:07.742097 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.742165 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 02:00:07.742985 29595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 2
I20260809 02:00:07.743721 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.743383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34058)
0809 02:00:07.743585 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.743635 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260809 02:00:07.744532 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.744285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34074)
0809 02:00:07.744413 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.744465 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260809 02:00:07.744679 29595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.744982 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.742832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34056)
0809 02:00:07.744834 (+ 2002us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.744903 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 02:00:07.745201 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
W20260809 02:00:07.774322 29601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:07.774720 29601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:07.774919 29601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:07.784426 29601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:07.784557 29601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:07.784639 29601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:07.784708 29601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:07.784782 29601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:07.796875 29601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40685,127.14.175.253:38073,127.14.175.252:34223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:34223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:07.798377 29601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:07.799934 29601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:07.810021 29609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:07.809989 29608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:07.809984 29611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:07.810554 29601 server_base.cc:1034] running on GCE node
I20260809 02:00:07.811125 29601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:07.812187 29601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:07.813431 29601 hybrid_clock.cc:648] HybridClock initialized: now 1786240807813407 us; error 38 us; skew 500 ppm
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:07.817039 29601 init.cc:377] Logged in from keytab as kudu/127.14.175.252@KRBTEST.COM (short username kudu)
I20260809 02:00:07.818018 29601 webserver.cc:460] Webserver started at http://127.14.175.252:44811/ using document root <none> and password file <none>
I20260809 02:00:07.818567 29601 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:07.818675 29601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:07.818912 29601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:07.820982 29601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data/instance:
uuid: "c06844a20dc4494ca2d67bae3860d19b"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "5399742e047dab4dd316be259d3183ad"
server_key_iv: "ca8f499b1e765be3916a9c5825dc24f5"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.821556 29601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal/instance:
uuid: "c06844a20dc4494ca2d67bae3860d19b"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "5399742e047dab4dd316be259d3183ad"
server_key_iv: "ca8f499b1e765be3916a9c5825dc24f5"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.825248 29601 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:00:07.827844 29619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:07.829061 29601 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:07.829198 29601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "c06844a20dc4494ca2d67bae3860d19b"
format_stamp: "Formatted at 2026-08-09 02:00:07 on dist-test-slave-2w3w"
server_key: "5399742e047dab4dd316be259d3183ad"
server_key_iv: "ca8f499b1e765be3916a9c5825dc24f5"
server_key_version: "encryptionkey@0"
I20260809 02:00:07.829305 29601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:07.835821 29595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 3
I20260809 02:00:07.836632 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.836340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34076)
0809 02:00:07.836491 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.836553 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 02:00:07.837491 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.837151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34090)
0809 02:00:07.837334 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.837400 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260809 02:00:07.837682 29595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.844369 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 3
I20260809 02:00:07.845094 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.844820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34104)
0809 02:00:07.844963 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.845020 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 02:00:07.845835 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.845626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34120)
0809 02:00:07.845732 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.845778 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:00:07.845994 29513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:34223: Network error: Client connection negotiation failed: client connection to 127.14.175.252:34223: connect: Connection refused (error 111)
I20260809 02:00:07.854274 29601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:07.857940 29601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:07.858145 29601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:07.866050 29601 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.252:34223
I20260809 02:00:07.866348 29674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.252:34223 every 8 connection(s)
I20260809 02:00:07.867177 29601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
I20260809 02:00:07.869908 29675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:07.873466 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29601
I20260809 02:00:07.873625 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786240649484061-15039-0/minicluster-data/master-2/wal/instance
I20260809 02:00:07.873955 15039 external_mini_cluster.cc:1428] Setting key 79b35e042e578167f93c940fb71ba987
I20260809 02:00:07.873646 29675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:00:07.889029 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.875583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58858 (local address 127.14.175.254:40685)
0809 02:00:07.875724 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.875730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.876015 (+ 285us) server_negotiation.cc:407] Connection header received
0809 02:00:07.877383 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.877386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.877444 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.877559 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.878597 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.879410 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.881416 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.881754 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.881873 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.884408 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.884411 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.884414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.884440 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.886457 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.887207 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.887211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.887212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.887307 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.887665 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.887670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.887672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.887934 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.888052 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.888696 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.888817 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:00:07.890590 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.875298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34122 (local address 127.14.175.252:34223)
0809 02:00:07.875937 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.875951 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.875998 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:00:07.877117 (+ 1119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.877143 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.877413 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.878668 (+ 1255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.878772 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.879855 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.880720 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.881296 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.881549 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.884892 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.884903 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.884913 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.884933 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.888433 (+ 3500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.888942 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.888948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.888950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.889033 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.889361 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.889363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.889364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.889590 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.889807 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.890041 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.890186 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":489,"thread_start_us":115,"threads_started":1}
I20260809 02:00:07.890588 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.875512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40685 (local address 127.0.0.1:58858)
0809 02:00:07.875876 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.875923 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.877152 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.877606 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.877615 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.877944 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.878448 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.878460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.879557 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.879560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.881244 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.881259 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.881912 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.881918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.882044 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.882579 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.882605 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.884231 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.886571 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.886581 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.886589 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.887071 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.887391 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.887396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.887398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.887546 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.888074 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.888083 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.888414 (+ 331us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.888649 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.889031 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":131,"thread_start_us":110,"threads_started":1}
I20260809 02:00:07.891954 29675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:07.903191 29602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.892549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.14.175.253:38073)
0809 02:00:07.892716 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.892722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.893018 (+ 296us) server_negotiation.cc:407] Connection header received
0809 02:00:07.893160 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.893164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.893228 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.893331 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.893986 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.894706 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.895708 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.895981 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.896102 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.899409 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.899412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.899414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.899437 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.900893 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.901461 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.901467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.901470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.901574 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.901914 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.901918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.901920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.902151 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.902259 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.902709 (+ 450us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.902892 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:00:07.903831 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.892458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:38073 (local address 127.0.0.1:57752)
0809 02:00:07.892932 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.892946 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.893027 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.893465 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.893471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.893681 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.893813 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.893840 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.894846 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.894849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.895589 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.895597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.896102 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.896106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.896200 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.896988 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.896998 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.899240 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.901014 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.901018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.901022 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.901312 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.901709 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.901712 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.901713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.901791 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.902309 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.902315 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.902454 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.903413 (+ 959us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.903573 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409}
I20260809 02:00:07.904608 29675 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:00:07.905107 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.893305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58874 (local address 127.14.175.254:40685)
0809 02:00:07.893405 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.893409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.893466 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:00:07.893573 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.893576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.893618 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.893704 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.894477 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.895281 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.896569 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.896804 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.896884 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.900877 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.900884 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.900889 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.900920 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.902936 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.903550 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.903554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.903556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.903641 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.904129 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.904132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.904133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.904360 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.904593 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.904805 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.904918 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:00:07.915287 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.905062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34126)
0809 02:00:07.905369 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.905385 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.905462 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.905715 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.905721 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.905930 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.906047 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.906056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.907257 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.907260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.908193 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.908205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.909070 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.909074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.909175 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.909676 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.909696 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.911343 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.913371 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.913376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.913380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.913668 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.914020 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.914024 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.914027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.914126 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.914580 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.914585 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.914697 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.914856 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.915035 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260809 02:00:07.915623 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.905257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.14.175.252:34223)
0809 02:00:07.905442 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.905446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.905460 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:00:07.905545 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.905547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.905590 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.905677 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.906190 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.907133 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.908363 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.908819 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.908923 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.911515 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.911518 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.911521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.911544 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.913267 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.913791 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.913799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.913801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.913904 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.914242 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.914246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.914248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.914460 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.914567 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.915099 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.915221 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 02:00:07.916162 29602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.906243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.14.175.253:38073)
0809 02:00:07.906344 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.906348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.906405 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:00:07.906527 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.906530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.906567 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.906658 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.907296 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.907761 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.908595 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.908816 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.908920 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.912315 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.912321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.912327 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.912351 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.913938 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.914412 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.914416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.914418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.914497 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.914802 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.914807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.914826 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.915080 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.915291 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.915894 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.916015 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:00:07.919426 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:00:07.920462 29675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: Bootstrap starting.
I20260809 02:00:07.923452 29675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:07.924309 29675 log.cc:824] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:07.928833 29675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: No bootstrap required, opened a new log
I20260809 02:00:07.931613 29602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.921509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.14.175.253:38073)
0809 02:00:07.921677 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.921682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.921943 (+ 261us) server_negotiation.cc:407] Connection header received
0809 02:00:07.922122 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.922126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.922166 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.922211 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.923132 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.923856 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.925919 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.926211 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.926327 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.927853 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.927856 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.927859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.927882 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.929618 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.930193 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.930196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.930198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.930279 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.930593 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.930596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.930598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.930798 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.930895 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.931357 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.931468 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 02:00:07.931802 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.921534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58882 (local address 127.14.175.254:40685)
0809 02:00:07.921767 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.921771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.922115 (+ 344us) server_negotiation.cc:407] Connection header received
0809 02:00:07.922301 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.922305 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.922352 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.922403 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.923319 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.924050 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.925114 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.925441 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.925536 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.927715 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.927721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.927723 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.927755 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.929515 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.930122 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.930126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.930130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.930223 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.930552 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.930556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.930557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.930803 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.930933 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.931495 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.931620 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260809 02:00:07.933135 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.922194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.14.175.252:34223)
0809 02:00:07.922300 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.922304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.923455 (+ 1151us) server_negotiation.cc:407] Connection header received
0809 02:00:07.923605 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.923608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.923647 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.923691 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.924619 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.925268 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.926107 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.926471 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.926592 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.929134 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.929137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.929140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.929165 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.930894 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.931367 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.931373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.931375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.931457 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.931749 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.931752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.931754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.932186 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.932307 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.932907 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.933017 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:00:07.933548 29675 raft_consensus.cc:348] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:07.933871 29675 raft_consensus.cc:374] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:07.933944 29675 raft_consensus.cc:729] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c06844a20dc4494ca2d67bae3860d19b, State: Initialized, Role: FOLLOWER
I20260809 02:00:07.934357 29675 consensus_queue.cc:260] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:07.934795 29688 sys_catalog.cc:455] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:07.934926 29688 sys_catalog.cc:458] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:07.935585 29675 sys_catalog.cc:564] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:00:07.940400 29700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:00:07.940546 29700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:00:07.938845 29601 master_runner.cc:186] Error getting master registration for 127.14.175.254:40685: OK, instance_id { permanent_uuid: "156af933921e4a61b041718d17a7042f" instance_seqno: 1786240807373459 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:00:07.941951 29601 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:00:07.980865 29595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 4
Aug 09 02:00:07 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:00:07.990154 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.981390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34144 (local address 127.14.175.252:34223)
0809 02:00:07.981526 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:07.981530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:07.981544 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:00:07.981634 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:07.981637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:07.981678 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:07.981757 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:07.982172 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.982989 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.983744 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.984095 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.984193 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.986402 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:07.986406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:07.986409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:07.986434 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:07.988580 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.989059 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.989061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.989062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.989137 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:07.989414 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:07.989416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:07.989417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:07.989594 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:07.989668 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:07.989948 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 02:00:07.990040 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:00:07.990196 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:07.981277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34144)
0809 02:00:07.981445 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:07.981469 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:07.981549 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:07.981782 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:07.981783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:07.981973 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:07.982064 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.982069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.983113 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.983115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.983622 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:07.983629 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:07.984209 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:07.984211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:07.984277 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:07.984800 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:07.984811 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:07.986269 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:07.988699 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.988702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.988704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.988961 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.989228 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:07.989231 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:07.989233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:07.989328 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:07.989686 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:07.989689 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:07.989790 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 02:00:07.989903 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 02:00:07.990033 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 02:00:07.993018 29595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: Bootstrap starting.
I20260809 02:00:07.995362 29595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:07.996089 29595 log.cc:824] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:07.997956 29595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: No bootstrap required, opened a new log
I20260809 02:00:08.001223 29595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.001453 29595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:08.001513 29595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7582355340044d85babaac88f7888634, State: Initialized, Role: FOLLOWER
I20260809 02:00:08.001960 29595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.002432 29703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.002578 29703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.003257 29595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:00:08.008885 29716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:00:08.008965 29716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:00:08.007144 29520 master_runner.cc:186] Error getting master registration for 127.14.175.254:40685: OK, instance_id { permanent_uuid: "156af933921e4a61b041718d17a7042f" instance_seqno: 1786240807373459 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:00:08.010039 29520 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:00:08.010129 29513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } attempt: 4
Aug 09 02:00:08 dist-test-slave-2w3w krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240807, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:00:08.019214 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:08.010552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:34223 (local address 127.0.0.1:34146)
0809 02:00:08.010686 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:08.010702 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:08.010787 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:08.011077 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:08.011080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:08.011284 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:08.011484 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:08.011492 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:08.012280 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:08.012284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:08.012821 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:08.012829 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:08.013305 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:08.013309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:08.013394 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:08.013926 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:08.013943 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:08.015657 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:08.017627 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:08.017630 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:08.017632 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:08.017842 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:08.018138 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:08.018142 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:08.018144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:08.018235 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:08.018644 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:08.018647 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:08.018749 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 02:00:08.018861 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 02:00:08.019045 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 02:00:08.019213 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:08.010642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34146 (local address 127.14.175.252:34223)
0809 02:00:08.010766 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:08.010770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:08.010784 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:00:08.010872 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:08.010877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:08.010917 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:08.011061 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:08.011639 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:08.012164 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:08.012947 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:08.013185 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:08.013293 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:08.015804 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:08.015808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:08.015810 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:08.015837 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:08.017480 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:08.017946 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:08.017951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:08.017952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:08.018039 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:08.018346 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:08.018349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:08.018351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:08.018538 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:08.018650 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:08.018913 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 02:00:08.019056 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:00:08.022352 29513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: Bootstrap starting.
I20260809 02:00:08.024672 29513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:08.025413 29513 log.cc:824] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:08.027276 29513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: No bootstrap required, opened a new log
I20260809 02:00:08.030377 29513 raft_consensus.cc:348] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.030616 29513 raft_consensus.cc:374] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:08.030668 29513 raft_consensus.cc:729] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156af933921e4a61b041718d17a7042f, State: Initialized, Role: FOLLOWER
I20260809 02:00:08.031160 29513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.032255 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.032454 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.033155 29513 sys_catalog.cc:564] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:00:08.038498 29731 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:00:08.038628 29731 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:00:08.041702 29438 master_runner.cc:263] No leader master found from master 156af933921e4a61b041718d17a7042f
I20260809 02:00:08.041787 29438 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:00:08.056016 29688 raft_consensus.cc:482] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:08.056192 29688 raft_consensus.cc:504] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.057204 29688 leader_election.cc:288] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156af933921e4a61b041718d17a7042f (127.14.175.254:40685), 7582355340044d85babaac88f7888634 (127.14.175.253:38073)
I20260809 02:00:08.058257 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c06844a20dc4494ca2d67bae3860d19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156af933921e4a61b041718d17a7042f" is_pre_election: true
I20260809 02:00:08.058558 29485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c06844a20dc4494ca2d67bae3860d19b in term 0.
I20260809 02:00:08.059170 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c06844a20dc4494ca2d67bae3860d19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7582355340044d85babaac88f7888634" is_pre_election: true
I20260809 02:00:08.059453 29566 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c06844a20dc4494ca2d67bae3860d19b in term 0.
I20260809 02:00:08.059875 29621 leader_election.cc:302] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156af933921e4a61b041718d17a7042f, c06844a20dc4494ca2d67bae3860d19b; no voters:
I20260809 02:00:08.060495 29688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:08.060607 29688 raft_consensus.cc:482] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:08.060663 29688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:08.062039 29688 raft_consensus.cc:504] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.062389 29688 leader_election.cc:288] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [CANDIDATE]: Term 1 election: Requested vote from peers 156af933921e4a61b041718d17a7042f (127.14.175.254:40685), 7582355340044d85babaac88f7888634 (127.14.175.253:38073)
I20260809 02:00:08.064750 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c06844a20dc4494ca2d67bae3860d19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156af933921e4a61b041718d17a7042f"
I20260809 02:00:08.064879 29485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:08.066176 29485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c06844a20dc4494ca2d67bae3860d19b in term 1.
I20260809 02:00:08.066406 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c06844a20dc4494ca2d67bae3860d19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7582355340044d85babaac88f7888634"
I20260809 02:00:08.066540 29566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:08.067786 29566 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c06844a20dc4494ca2d67bae3860d19b in term 1.
I20260809 02:00:08.068130 29622 leader_election.cc:302] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7582355340044d85babaac88f7888634, c06844a20dc4494ca2d67bae3860d19b; no voters:
I20260809 02:00:08.069211 29688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:08.069454 29688 raft_consensus.cc:686] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [term 1 LEADER]: Becoming Leader. State: Replica: c06844a20dc4494ca2d67bae3860d19b, State: Running, Role: LEADER
I20260809 02:00:08.069794 29688 consensus_queue.cc:237] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } }
I20260809 02:00:08.071493 29688 sys_catalog.cc:455] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c06844a20dc4494ca2d67bae3860d19b. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.071607 29688 sys_catalog.cc:458] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:08.071974 29738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:08.072926 29738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 02:00:08.076349 29542 tablet.cc:2369] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:08.079360 29566 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [term 1 FOLLOWER]: Refusing update from remote peer c06844a20dc4494ca2d67bae3860d19b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:08.079958 29688 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:08.088302 29703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c06844a20dc4494ca2d67bae3860d19b. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.088423 29703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.089386 29485 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [term 1 FOLLOWER]: Refusing update from remote peer c06844a20dc4494ca2d67bae3860d19b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:08.089967 29736 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:08.093374 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c06844a20dc4494ca2d67bae3860d19b. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.093518 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.095976 29736 sys_catalog.cc:455] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.096082 29736 sys_catalog.cc:458] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:08.097090 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.097214 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.097628 29739 mvcc.cc:205] Tried to move back new op lower bound from 7316442349886185472 to 7316442349856849920. Current Snapshot: MvccSnapshot[applied={T|T < 7316442349886185472}]
I20260809 02:00:08.099699 29743 mvcc.cc:205] Tried to move back new op lower bound from 7316442349886185472 to 7316442349856849920. Current Snapshot: MvccSnapshot[applied={T|T < 7316442349886185472}]
I20260809 02:00:08.101413 29738 catalog_manager.cc:1347] Generated new cluster ID: cd7f140b7c1847b4bcb993664902dac1
I20260809 02:00:08.101466 29738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:08.106683 29688 sys_catalog.cc:455] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.106802 29688 sys_catalog.cc:458] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:08.107833 29741 mvcc.cc:205] Tried to move back new op lower bound from 7316442349886185472 to 7316442349856849920. Current Snapshot: MvccSnapshot[applied={T|T < 7316442349886185472}]
I20260809 02:00:08.107980 29703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c06844a20dc4494ca2d67bae3860d19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156af933921e4a61b041718d17a7042f" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40685 } } peers { permanent_uuid: "7582355340044d85babaac88f7888634" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 38073 } } peers { permanent_uuid: "c06844a20dc4494ca2d67bae3860d19b" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 34223 } } }
I20260809 02:00:08.108064 29703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:00:08.123136 29738 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:00:08.124537 29738 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:08.131174 29738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c06844a20dc4494ca2d67bae3860d19b: Generated new TSK 0
I20260809 02:00:08.131775 29738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:00:09.010233 29716 catalog_manager.cc:1259] Loaded cluster ID: cd7f140b7c1847b4bcb993664902dac1
I20260809 02:00:09.010316 29716 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: loading cluster ID for follower catalog manager: success
I20260809 02:00:09.012166 29716 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: acquiring CA information for follower catalog manager: success
I20260809 02:00:09.013329 29716 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7582355340044d85babaac88f7888634: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:00:09.039920 29731 catalog_manager.cc:1259] Loaded cluster ID: cd7f140b7c1847b4bcb993664902dac1
I20260809 02:00:09.039997 29731 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: loading cluster ID for follower catalog manager: success
I20260809 02:00:09.041571 29731 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: acquiring CA information for follower catalog manager: success
I20260809 02:00:09.042634 29731 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 156af933921e4a61b041718d17a7042f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:00:09.200317 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29438
I20260809 02:00:09.209494 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29520
I20260809 02:00:09.216583 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29601
2026-08-09T02:00:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3227 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:00:09 dist-test-slave-2w3w krb5kdc[29755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:00:09 dist-test-slave-2w3w krb5kdc[29755](info): set up 2 sockets
Aug 09 02:00:09 dist-test-slave-2w3w krb5kdc[29755](info): commencing operation
krb5kdc: starting...
W20260809 02:00:10.299896 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:00:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:00:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:00:10.429564 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:45229
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:46451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:45229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:10.549439 29768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:10.549734 29768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:10.549814 29768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:10.554255 29768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:10.554359 29768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:10.554401 29768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:10.554463 29768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:10.554524 29768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:10.560681 29768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:46451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:45229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:45229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:10.561899 29768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:10.563041 29768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:10.571753 29773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:10.571853 29774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:10.571970 29776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:10.572202 29768 server_base.cc:1034] running on GCE node
I20260809 02:00:10.572815 29768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:10.573977 29768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:10.575176 29768 hybrid_clock.cc:648] HybridClock initialized: now 1786240810575142 us; error 49 us; skew 500 ppm
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240810, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:10.577944 29768 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:10.578778 29768 webserver.cc:460] Webserver started at http://127.14.175.254:39395/ using document root <none> and password file <none>
I20260809 02:00:10.579392 29768 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:10.579483 29768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:10.579706 29768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:10.581677 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "d58eb86d040f48f2b7bd870c72e8d42c"
format_stamp: "Formatted at 2026-08-09 02:00:10 on dist-test-slave-2w3w"
server_key: "a72af328974679f0f292288896723034"
server_key_iv: "0028456ef2923de0bf983a7bd599fbb2"
server_key_version: "encryptionkey@0"
I20260809 02:00:10.582239 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "d58eb86d040f48f2b7bd870c72e8d42c"
format_stamp: "Formatted at 2026-08-09 02:00:10 on dist-test-slave-2w3w"
server_key: "a72af328974679f0f292288896723034"
server_key_iv: "0028456ef2923de0bf983a7bd599fbb2"
server_key_version: "encryptionkey@0"
I20260809 02:00:10.585871 29768 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:00:10.588210 29783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:10.589366 29768 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:10.589500 29768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "d58eb86d040f48f2b7bd870c72e8d42c"
format_stamp: "Formatted at 2026-08-09 02:00:10 on dist-test-slave-2w3w"
server_key: "a72af328974679f0f292288896723034"
server_key_iv: "0028456ef2923de0bf983a7bd599fbb2"
server_key_version: "encryptionkey@0"
I20260809 02:00:10.589612 29768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:10.609179 29768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:10.612385 29768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:10.612586 29768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:10.619719 29768 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:45229
I20260809 02:00:10.619803 29838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:45229 every 8 connection(s)
I20260809 02:00:10.620642 29768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:10.623307 29839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:10.626050 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29768
I20260809 02:00:10.626205 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:00:10.626504 15039 external_mini_cluster.cc:1428] Setting key 8d00d902bd6c53dad8b802a2bc581a1e
I20260809 02:00:10.629598 29839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: Bootstrap starting.
I20260809 02:00:10.632052 29839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:10.632879 29839 log.cc:824] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:10.634724 29839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: No bootstrap required, opened a new log
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:10.638244 29839 raft_consensus.cc:348] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } }
I20260809 02:00:10.638547 29839 raft_consensus.cc:374] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:10.638614 29839 raft_consensus.cc:729] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58eb86d040f48f2b7bd870c72e8d42c, State: Initialized, Role: FOLLOWER
I20260809 02:00:10.639129 29839 consensus_queue.cc:260] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } }
I20260809 02:00:10.639325 29839 raft_consensus.cc:388] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:10.639449 29839 raft_consensus.cc:482] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:10.639567 29839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:10.640686 29839 raft_consensus.cc:504] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } }
I20260809 02:00:10.641008 29839 leader_election.cc:302] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d58eb86d040f48f2b7bd870c72e8d42c; no voters:
I20260809 02:00:10.641300 29839 leader_election.cc:288] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:00:10.641407 29844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:10.641467 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:10.627751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48368 (local address 127.14.175.254:45229)
0809 02:00:10.628145 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:10.628160 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:10.628196 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:00:10.628811 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:10.628828 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:10.629128 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:10.629400 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:10.630324 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:10.631402 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:10.632546 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:10.633049 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:10.633162 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:10.635985 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:10.635990 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:10.636002 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:10.636028 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:10.638310 (+ 2282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:10.638799 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:10.638804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:10.638808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:10.639005 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:10.639315 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:10.639321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:10.639323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:10.639860 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:10.640019 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:10.640311 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 02:00:10.640589 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":134,"threads_started":1}
I20260809 02:00:10.641633 29844 raft_consensus.cc:686] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [term 1 LEADER]: Becoming Leader. State: Replica: d58eb86d040f48f2b7bd870c72e8d42c, State: Running, Role: LEADER
I20260809 02:00:10.641990 29844 consensus_queue.cc:237] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } }
I20260809 02:00:10.642477 29839 sys_catalog.cc:564] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:10.643110 29844 sys_catalog.cc:455] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } } }
I20260809 02:00:10.643230 29844 sys_catalog.cc:458] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:10.643435 29844 sys_catalog.cc:455] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d58eb86d040f48f2b7bd870c72e8d42c. Latest consensus state: current_term: 1 leader_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58eb86d040f48f2b7bd870c72e8d42c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 45229 } } }
I20260809 02:00:10.643515 29844 sys_catalog.cc:458] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:10.644433 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 02:00:10.647539 29861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:00:10.647624 29861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:00:10.647711 29851 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:10.648427 29851 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:10.653196 29851 catalog_manager.cc:1347] Generated new cluster ID: 35f6a8b0125a4219b4d4461924c9397c
I20260809 02:00:10.653259 29851 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:10.663650 29851 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:00:10.664589 29851 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:10.672016 29851 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d58eb86d040f48f2b7bd870c72e8d42c: Generated new TSK 0
I20260809 02:00:10.672608 29851 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:00:10.700682 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29768
2026-08-09T02:00:10Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1483 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29869](info): set up 2 sockets
Aug 09 02:00:10 dist-test-slave-2w3w krb5kdc[29869](info): commencing operation
krb5kdc: starting...
W20260809 02:00:11.772428 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:00:11 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:00:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:00:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:00:11.897415 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:43493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:12.008345 29883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:12.008670 29883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:12.008755 29883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:12.012826 29883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:12.012908 29883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:12.012948 29883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:12.013006 29883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:12.013047 29883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:12.018318 29883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:43493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:12.019510 29883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:12.020517 29883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:12.029125 29889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.029116 29888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.029211 29892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:12.029304 29883 server_base.cc:1034] running on GCE node
I20260809 02:00:12.029868 29883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:12.030941 29883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:12.032198 29883 hybrid_clock.cc:648] HybridClock initialized: now 1786240812032183 us; error 33 us; skew 500 ppm
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:12.040689 29883 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:12.041577 29883 webserver.cc:460] Webserver started at http://127.14.175.254:38775/ using document root <none> and password file <none>
I20260809 02:00:12.042125 29883 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:12.042217 29883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:12.042445 29883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:12.044513 29883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "85e8e2df9d8d4687a7922d4361c6dda5"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "5f7bf2dd5a7f9041f4c6df37c353312c"
server_key_iv: "8fef99f4f52459d960850c1e8b3fbfde"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.045089 29883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "85e8e2df9d8d4687a7922d4361c6dda5"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "5f7bf2dd5a7f9041f4c6df37c353312c"
server_key_iv: "8fef99f4f52459d960850c1e8b3fbfde"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.048692 29883 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 02:00:12.050911 29899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.052109 29883 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 02:00:12.052245 29883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "85e8e2df9d8d4687a7922d4361c6dda5"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "5f7bf2dd5a7f9041f4c6df37c353312c"
server_key_iv: "8fef99f4f52459d960850c1e8b3fbfde"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.052356 29883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:12.075050 29883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:12.077924 29883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:12.078128 29883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:12.085129 29883 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:43493
I20260809 02:00:12.085420 29951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:43493 every 8 connection(s)
I20260809 02:00:12.086099 29883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:12.088781 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:12.093930 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29883
I20260809 02:00:12.094097 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:00:12.094321 29952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap starting.
I20260809 02:00:12.094434 15039 external_mini_cluster.cc:1428] Setting key 7551d8f77055ba6bdeecf51de9791b06
I20260809 02:00:12.096905 29952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:12.097762 29952 log.cc:824] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:12.099807 29952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: No bootstrap required, opened a new log
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:12.104146 29952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:12.104386 29952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:12.104461 29952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Initialized, Role: FOLLOWER
I20260809 02:00:12.104983 29952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:12.105166 29952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:12.105238 29952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:12.105365 29952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:12.106216 29952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:12.106554 29952 leader_election.cc:302] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85e8e2df9d8d4687a7922d4361c6dda5; no voters:
I20260809 02:00:12.106884 29952 leader_election.cc:288] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:00:12.106978 29958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:12.107177 29958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 LEADER]: Becoming Leader. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Running, Role: LEADER
I20260809 02:00:12.107527 29958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:12.108165 29952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:12.109202 29960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:12.109325 29960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:12.109531 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.095771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43858 (local address 127.14.175.254:43493)
0809 02:00:12.096173 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.096190 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.096224 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:00:12.096846 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.096863 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.097217 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.097481 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:12.098413 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.099541 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.100682 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.101129 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.101251 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.104062 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:12.104066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:12.104077 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:12.104103 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:12.105989 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.106445 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.106451 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.106458 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.106572 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.106861 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.106866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.106867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.107431 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:12.107651 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.108254 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.108503 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":136,"threads_started":1}
I20260809 02:00:12.109619 29959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85e8e2df9d8d4687a7922d4361c6dda5. Latest consensus state: current_term: 1 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:12.109692 29959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:12.109740 29969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:12.112964 29969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:12.118218 29969 catalog_manager.cc:1347] Generated new cluster ID: cd7fc2af67ce49d68d484e2289937012
I20260809 02:00:12.118284 29969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:12.125903 29969 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:00:12.127105 29969 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:12.140496 29969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Generated new TSK 0
I20260809 02:00:12.141299 29969 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:00:12.174270 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:12.282337 29981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:12.282608 29981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:12.282681 29981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:12.286662 29981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:12.286747 29981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:12.286840 29981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:12.291982 29981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:12.292965 29981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:12.293946 29981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:12.303227 29989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.303242 29986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.303251 29987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:12.303650 29981 server_base.cc:1034] running on GCE node
I20260809 02:00:12.303958 29981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:12.304494 29981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:12.305653 29981 hybrid_clock.cc:648] HybridClock initialized: now 1786240812305635 us; error 29 us; skew 500 ppm
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:12.308362 29981 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:12.309290 29981 webserver.cc:460] Webserver started at http://127.14.175.193:41075/ using document root <none> and password file <none>
I20260809 02:00:12.309971 29981 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:12.310071 29981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:12.310271 29981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:12.312304 29981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "0612ebb63f84deca1616aa29665d9360"
server_key_iv: "4f5caf0bbb9fb4558981e5bf1733378b"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.312893 29981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "0612ebb63f84deca1616aa29665d9360"
server_key_iv: "4f5caf0bbb9fb4558981e5bf1733378b"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.316437 29981 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:00:12.318621 29996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.319761 29981 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:00:12.319937 29981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "0612ebb63f84deca1616aa29665d9360"
server_key_iv: "4f5caf0bbb9fb4558981e5bf1733378b"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.320078 29981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:12.336814 29981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:12.339367 29981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:12.339512 29981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:12.339988 29981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:12.340782 29981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:12.340829 29981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.340866 29981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:12.340888 29981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.349324 29981 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:34843
I20260809 02:00:12.349349 30116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:34843 every 8 connection(s)
I20260809 02:00:12.350229 29981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:12.350564 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 29981
I20260809 02:00:12.350713 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:00:12.351095 15039 external_mini_cluster.cc:1428] Setting key 2c38c19c15aef4e03c3c80034c77b94a
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 02:00:12.364836 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.352223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:40649 (local address 127.14.175.254:43493)
0809 02:00:12.352361 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.352366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.353287 (+ 921us) server_negotiation.cc:407] Connection header received
0809 02:00:12.354638 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.354641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.354694 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.354828 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:12.356076 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.356722 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.358036 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.358268 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.358404 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.361136 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:12.361139 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:12.361141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:12.361164 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:12.362660 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.363257 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.363261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.363263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.363349 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.363702 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.363705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.363707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.363883 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:12.363993 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.364537 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.364662 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:00:12.365593 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.352642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:40649)
0809 02:00:12.353149 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.353191 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.354434 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.355019 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.355027 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.355460 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:12.355922 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.355936 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.356850 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.356854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.357901 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.357911 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.358453 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.358457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.358636 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.359291 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:12.359307 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:12.360961 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:12.362788 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.362794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.362807 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.363151 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.363444 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.363448 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.363450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.363596 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.363994 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:12.364001 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:12.364244 (+ 243us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.364465 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.364779 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":137,"threads_started":1}
I20260809 02:00:12.367331 30117 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:12.367578 30117 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:12.368052 30117 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
I20260809 02:00:12.369654 29916 ts_manager.cc:194] Registered new tserver with Master: a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:12.371300 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:40649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 02:00:12.379487 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:12.489189 30122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:12.489465 30122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:12.489548 30122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:12.493503 30122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:12.493589 30122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:12.493678 30122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:12.498739 30122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:12.499785 30122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:12.500752 30122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:12.510064 30128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.510059 30131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.510089 30129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:12.510245 30122 server_base.cc:1034] running on GCE node
I20260809 02:00:12.510847 30122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:12.511575 30122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:12.514863 30122 hybrid_clock.cc:648] HybridClock initialized: now 1786240812514834 us; error 34 us; skew 500 ppm
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:12.517689 30122 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:12.518555 30122 webserver.cc:460] Webserver started at http://127.14.175.194:34817/ using document root <none> and password file <none>
I20260809 02:00:12.519155 30122 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:12.519217 30122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:12.519475 30122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:12.521401 30122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "79751eeca335ff28695d9b07c1f16d90"
server_key_iv: "e983ac0276752bd615a9a9022993d7f0"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.521942 30122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "79751eeca335ff28695d9b07c1f16d90"
server_key_iv: "e983ac0276752bd615a9a9022993d7f0"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.525681 30122 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260809 02:00:12.528265 30138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.529479 30122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:12.529606 30122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "79751eeca335ff28695d9b07c1f16d90"
server_key_iv: "e983ac0276752bd615a9a9022993d7f0"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.529711 30122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:12.554050 30122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:12.557425 30122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:12.557638 30122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:12.558219 30122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:12.559094 30122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:12.559147 30122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.559207 30122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:12.559244 30122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.568059 30122 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44573
I20260809 02:00:12.568090 30259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44573 every 8 connection(s)
I20260809 02:00:12.568913 30122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:00:12.575312 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30122
I20260809 02:00:12.575449 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:00:12.575749 15039 external_mini_cluster.cc:1428] Setting key 535f34c6891fd5024377b12debdb47ba
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:12.583508 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.570688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:37513 (local address 127.14.175.254:43493)
0809 02:00:12.570821 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.570826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.571601 (+ 775us) server_negotiation.cc:407] Connection header received
0809 02:00:12.572981 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.572985 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.573054 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.573158 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:12.574323 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.575187 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.576611 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.576851 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.576966 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.579619 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:12.579622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:12.579624 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:12.579645 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:12.581219 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.581886 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.581889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.581890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.581973 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.582366 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.582368 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.582369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.582542 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:12.582621 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.583287 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.583394 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:00:12.584750 30262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.570981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:37513)
0809 02:00:12.571445 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.571487 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.572772 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.573332 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.573338 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.573680 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:12.574143 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.574156 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.575348 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.575351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.576500 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.576513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.577025 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.577032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.577223 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.577831 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:12.577847 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:12.579455 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:12.581345 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.581353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.581370 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.581745 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.582070 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.582076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.582081 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.582269 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.582653 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:12.582660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:12.583009 (+ 349us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.583239 (+ 230us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.583598 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":114,"threads_started":1}
I20260809 02:00:12.585938 30260 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:12.586159 30260 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:12.586630 30260 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 02:00:12.587714 29916 ts_manager.cc:194] Registered new tserver with Master: ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573)
I20260809 02:00:12.588258 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:37513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:00:12.605407 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:12.714128 30265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:12.714402 30265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:12.714475 30265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:12.718524 30265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:12.718606 30265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:12.718691 30265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:12.723953 30265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:12.724977 30265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:12.725934 30265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:12.735224 30273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.735227 30271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:12.735227 30270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:12.735486 30265 server_base.cc:1034] running on GCE node
I20260809 02:00:12.735894 30265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:12.736476 30265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:12.737629 30265 hybrid_clock.cc:648] HybridClock initialized: now 1786240812737612 us; error 29 us; skew 500 ppm
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:12.740435 30265 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:12.741328 30265 webserver.cc:460] Webserver started at http://127.14.175.195:35815/ using document root <none> and password file <none>
I20260809 02:00:12.741837 30265 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:12.741895 30265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:12.742116 30265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:12.744041 30265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "1d00d6bd8d35438a93e0822c58b1970c"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "64a63a2831880116b0b42bbd4b386bf1"
server_key_iv: "e1dcbcd2fbc12884c0d87c8c3a1f3482"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.744601 30265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "1d00d6bd8d35438a93e0822c58b1970c"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "64a63a2831880116b0b42bbd4b386bf1"
server_key_iv: "e1dcbcd2fbc12884c0d87c8c3a1f3482"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.748077 30265 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:00:12.750345 30280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.751546 30265 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:00:12.751678 30265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1d00d6bd8d35438a93e0822c58b1970c"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "64a63a2831880116b0b42bbd4b386bf1"
server_key_iv: "e1dcbcd2fbc12884c0d87c8c3a1f3482"
server_key_version: "encryptionkey@0"
I20260809 02:00:12.751784 30265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:12.773211 30265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:12.776449 30265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:12.776648 30265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:12.777223 30265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:12.778034 30265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:12.778103 30265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.778172 30265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:12.778223 30265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:12.786928 30265 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:41081
I20260809 02:00:12.787011 30407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:41081 every 8 connection(s)
I20260809 02:00:12.787863 30265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:12.791764 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30265
I20260809 02:00:12.791890 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:00:12.792223 15039 external_mini_cluster.cc:1428] Setting key 4e8c10021ba22b3c9a9e0197611241db
Aug 09 02:00:12 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240812, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:12.801693 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.789674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:46349 (local address 127.14.175.254:43493)
0809 02:00:12.789829 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.789834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.790609 (+ 775us) server_negotiation.cc:407] Connection header received
0809 02:00:12.791962 (+ 1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.791966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.792031 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.792135 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:12.793513 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.794307 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.795549 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.795785 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.795900 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.798333 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:12.798336 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:12.798339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:12.798365 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:12.799715 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.800223 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.800227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.800228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.800313 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.800647 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.800652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.800654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.800835 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:12.800941 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.801404 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.801525 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:00:12.802505 30412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.790025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:46349)
0809 02:00:12.790458 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.790499 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.791709 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.792301 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.792309 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.792709 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:12.793373 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.793388 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.794458 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.794462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.795420 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.795429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.795936 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.795940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.796116 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.796726 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:12.796741 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:12.798162 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:12.799842 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.799848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.799861 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.800120 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.800405 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:12.800409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:12.800411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:12.800547 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:12.800939 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:12.800945 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:12.801177 (+ 232us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.801363 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.801669 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":106,"threads_started":1}
I20260809 02:00:12.803647 30408 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:12.803898 30408 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:12.804397 30408 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
I20260809 02:00:12.805466 29916 ts_manager.cc:194] Registered new tserver with Master: 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081)
I20260809 02:00:12.806181 29916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:46349
I20260809 02:00:12.806331 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:12.815958 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.808467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43872 (local address 127.14.175.254:43493)
0809 02:00:12.808620 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.808626 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.808905 (+ 279us) server_negotiation.cc:407] Connection header received
0809 02:00:12.809060 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.809064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.809108 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.809195 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:12.809879 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.810407 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.811348 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.811576 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.811687 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.813017 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:12.813020 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:12.813023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:12.813047 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:12.814201 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.814631 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.814635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.814637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.814719 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:12.815069 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:12.815072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:12.815074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:12.815293 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:12.815458 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.815691 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.815800 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:00:12.818708 29916 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:00:12.822045 29916 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:00:12.836932 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.831519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35790 (local address 127.14.175.195:41081)
0809 02:00:12.832237 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.832249 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.832275 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:00:12.832513 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.832518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.832666 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.832819 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:12.833136 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834097 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.835653 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.836200 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.836338 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.836470 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.836685 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.836775 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":167,"threads_started":1}
I20260809 02:00:12.836916 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.830723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:41081 (local address 127.0.0.1:35790)
0809 02:00:12.832088 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.832141 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.832270 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.832835 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.832841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.832864 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:12.833001 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.833008 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834352 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.834358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.835529 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.835539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.836331 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.836335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.836454 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.836498 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.836653 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.836775 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":73,"threads_started":1}
I20260809 02:00:12.837934 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.830882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44573 (local address 127.0.0.1:37114)
0809 02:00:12.832088 (+ 1206us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.832141 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.832287 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.833000 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.833009 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.833025 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:12.833193 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.833199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834744 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.834747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.836246 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.836257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.837547 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.837550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.837639 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.837660 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.837728 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.837793 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":185,"spinlock_wait_cycles":2304,"thread_start_us":131,"threads_started":1}
I20260809 02:00:12.838366 30423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.831076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37114 (local address 127.14.175.194:44573)
0809 02:00:12.831818 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.831832 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.832229 (+ 397us) server_negotiation.cc:407] Connection header received
0809 02:00:12.832465 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.832471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.832666 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.832794 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:12.833341 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834581 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.836391 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.837223 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.837320 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.837433 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.838123 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.838223 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":126,"threads_started":1}
I20260809 02:00:12.838601 30422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.831193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.0.0.1:60468)
0809 02:00:12.832221 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:12.832235 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:12.832340 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:12.833017 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:12.833020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:12.833038 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:12.833185 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.833190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834744 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.834747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.836246 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:12.836257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.838207 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.838211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:12.838291 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.838311 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:00:12.838396 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:00:12.838472 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"mutex_wait_us":153,"thread_start_us":93,"threads_started":1}
I20260809 02:00:12.839041 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:12.831628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60468 (local address 127.14.175.193:34843)
0809 02:00:12.832041 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:12.832056 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:12.832383 (+ 327us) server_negotiation.cc:407] Connection header received
0809 02:00:12.832545 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:12.832551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:12.832697 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:12.832861 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:12.833295 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.834600 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.836396 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:12.837223 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:12.837332 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:12.838147 (+ 815us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:12.838795 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 02:00:12.838877 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":95,"threads_started":1}
I20260809 02:00:12.840408 30331 tablet_service.cc:1467] Processing CreateTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 (DEFAULT_TABLE table=test-table [id=ddd89f2523574e1ca8a0c70273a6debf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:12.841058 30188 tablet_service.cc:1467] Processing CreateTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 (DEFAULT_TABLE table=test-table [id=ddd89f2523574e1ca8a0c70273a6debf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:12.841531 30331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14fb69ba08e4fcc9e2b97412339bd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:12.842056 30188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14fb69ba08e4fcc9e2b97412339bd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:12.844378 30049 tablet_service.cc:1467] Processing CreateTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 (DEFAULT_TABLE table=test-table [id=ddd89f2523574e1ca8a0c70273a6debf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:12.845170 30049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14fb69ba08e4fcc9e2b97412339bd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:12.849123 30428 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Bootstrap starting.
I20260809 02:00:12.849537 30427 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Bootstrap starting.
I20260809 02:00:12.852355 30427 tablet_bootstrap.cc:654] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:12.852538 30429 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap starting.
I20260809 02:00:12.853188 30427 log.cc:824] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:12.853401 30428 tablet_bootstrap.cc:654] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:12.854204 30428 log.cc:824] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:12.854691 30429 tablet_bootstrap.cc:654] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:12.855160 30427 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: No bootstrap required, opened a new log
I20260809 02:00:12.855365 30427 ts_tablet_manager.cc:1397] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:00:12.856055 30429 log.cc:824] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:12.856323 30428 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: No bootstrap required, opened a new log
I20260809 02:00:12.856521 30428 ts_tablet_manager.cc:1397] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 02:00:12.858860 30427 raft_consensus.cc:348] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.859185 30427 raft_consensus.cc:374] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:12.859274 30427 raft_consensus.cc:729] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee18bd5297b547c79a944d2fbcc3cc10, State: Initialized, Role: FOLLOWER
I20260809 02:00:12.859750 30427 consensus_queue.cc:260] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.859710 30428 raft_consensus.cc:348] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.859923 30428 raft_consensus.cc:374] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:12.859987 30428 raft_consensus.cc:729] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d00d6bd8d35438a93e0822c58b1970c, State: Initialized, Role: FOLLOWER
I20260809 02:00:12.860411 30260 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
I20260809 02:00:12.860447 30428 consensus_queue.cc:260] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.860714 30427 ts_tablet_manager.cc:1428] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:00:12.861002 30408 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
I20260809 02:00:12.861295 30428 ts_tablet_manager.cc:1428] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:00:12.862560 30429 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: No bootstrap required, opened a new log
I20260809 02:00:12.862782 30429 ts_tablet_manager.cc:1397] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260809 02:00:12.866088 30429 raft_consensus.cc:348] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.866272 30429 raft_consensus.cc:374] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:12.866360 30429 raft_consensus.cc:729] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a74eb668d6d34f1c8b0cbb0775af680d, State: Initialized, Role: FOLLOWER
I20260809 02:00:12.866721 30429 consensus_queue.cc:260] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:12.867357 30117 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
I20260809 02:00:12.867605 30429 ts_tablet_manager.cc:1428] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
W20260809 02:00:13.038873 30409 tablet.cc:2369] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:13.050056 30434 raft_consensus.cc:482] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:13.050297 30434 raft_consensus.cc:504] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:13.051916 30434 leader_election.cc:288] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:13.056409 30412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.052133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44573 (local address 127.14.175.195:36501)
0809 02:00:13.052485 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.052501 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:13.052604 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:13.053125 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:13.053128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:13.053151 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:13.053277 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.053283 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.054119 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.054122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.055096 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.055108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.055954 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.055956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.056065 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.056092 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:00:13.056173 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:00:13.056242 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":20}
I20260809 02:00:13.056423 30423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.052698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:36501 (local address 127.14.175.194:44573)
0809 02:00:13.052846 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.052852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.052871 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:00:13.052933 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.052936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.052989 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.053097 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:13.053399 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.054004 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.055235 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.055839 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.055960 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.056014 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.056192 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.056264 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:00:13.056571 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.052336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:50951 (local address 127.14.175.193:34843)
0809 02:00:13.052488 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.052494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.053130 (+ 636us) server_negotiation.cc:407] Connection header received
0809 02:00:13.053226 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.053229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.053283 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.053375 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:13.053654 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.054175 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.055368 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.055984 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.056094 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.056146 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.056364 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.056450 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:00:13.056618 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.052432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.14.175.195:50951)
0809 02:00:13.053029 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.053045 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:13.053143 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:13.053396 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:13.053399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:13.053415 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:13.053544 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.053551 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.054288 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.054291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.055222 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.055238 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.056091 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.056094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.056200 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.056262 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 02:00:13.056331 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:00:13.056385 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":16,"thread_start_us":132,"threads_started":1}
I20260809 02:00:13.057226 30069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14fb69ba08e4fcc9e2b97412339bd31" candidate_uuid: "1d00d6bd8d35438a93e0822c58b1970c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" is_pre_election: true
I20260809 02:00:13.057567 30069 raft_consensus.cc:2454] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d00d6bd8d35438a93e0822c58b1970c in term 0.
I20260809 02:00:13.057559 30208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14fb69ba08e4fcc9e2b97412339bd31" candidate_uuid: "1d00d6bd8d35438a93e0822c58b1970c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" is_pre_election: true
I20260809 02:00:13.057862 30208 raft_consensus.cc:2454] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d00d6bd8d35438a93e0822c58b1970c in term 0.
I20260809 02:00:13.058063 30283 leader_election.cc:302] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d00d6bd8d35438a93e0822c58b1970c, a74eb668d6d34f1c8b0cbb0775af680d; no voters:
I20260809 02:00:13.058365 30434 raft_consensus.cc:2781] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:13.058455 30434 raft_consensus.cc:482] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:13.058488 30434 raft_consensus.cc:3037] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:13.059736 30434 raft_consensus.cc:504] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:13.060106 30434 leader_election.cc:288] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [CANDIDATE]: Term 1 election: Requested vote from peers ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:13.060410 30208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14fb69ba08e4fcc9e2b97412339bd31" candidate_uuid: "1d00d6bd8d35438a93e0822c58b1970c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
I20260809 02:00:13.060460 30069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14fb69ba08e4fcc9e2b97412339bd31" candidate_uuid: "1d00d6bd8d35438a93e0822c58b1970c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
I20260809 02:00:13.060541 30208 raft_consensus.cc:3037] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:13.060602 30069 raft_consensus.cc:3037] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:13.061645 30069 raft_consensus.cc:2454] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d00d6bd8d35438a93e0822c58b1970c in term 1.
I20260809 02:00:13.061689 30208 raft_consensus.cc:2454] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d00d6bd8d35438a93e0822c58b1970c in term 1.
I20260809 02:00:13.062041 30284 leader_election.cc:302] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d00d6bd8d35438a93e0822c58b1970c, ee18bd5297b547c79a944d2fbcc3cc10; no voters:
I20260809 02:00:13.062220 30434 raft_consensus.cc:2781] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:13.062445 30434 raft_consensus.cc:686] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 LEADER]: Becoming Leader. State: Replica: 1d00d6bd8d35438a93e0822c58b1970c, State: Running, Role: LEADER
I20260809 02:00:13.062790 30434 consensus_queue.cc:237] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:13.065685 29915 catalog_manager.cc:5495] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195). New cstate: current_term: 1 leader_uuid: "1d00d6bd8d35438a93e0822c58b1970c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } health_report { overall_health: UNKNOWN } } }
W20260809 02:00:13.069974 30261 tablet.cc:2369] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:00:13.101653 30118 tablet.cc:2369] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:13.128042 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.124231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35798 (local address 127.14.175.195:41081)
0809 02:00:13.124387 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.124394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.124415 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:00:13.124635 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.124638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.124694 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.124810 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:13.125089 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.125605 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.126486 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.126707 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.126872 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.127218 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:13.127632 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:13.127798 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.127834 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.127890 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:00:13.133919 30069 raft_consensus.cc:1261] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Refusing update from remote peer 1d00d6bd8d35438a93e0822c58b1970c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:13.134044 30208 raft_consensus.cc:1261] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Refusing update from remote peer 1d00d6bd8d35438a93e0822c58b1970c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:13.134742 30437 consensus_queue.cc:1035] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:13.134932 30434 consensus_queue.cc:1035] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:13.143203 30441 mvcc.cc:205] Tried to move back new op lower bound from 7316442370589466624 to 7316442370307731456. Current Snapshot: MvccSnapshot[applied={T|T < 7316442370589466624}]
I20260809 02:00:13.148902 29915 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:13.149073 29915 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:13.151515 29915 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Sending DeleteTablet for 3 replicas of tablet c14fb69ba08e4fcc9e2b97412339bd31
I20260809 02:00:13.152236 30188 tablet_service.cc:1514] Processing DeleteTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:13 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:37114
I20260809 02:00:13.152271 30331 tablet_service.cc:1514] Processing DeleteTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:13 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:35790
I20260809 02:00:13.152467 30049 tablet_service.cc:1514] Processing DeleteTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:13 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:60468
I20260809 02:00:13.152814 30450 tablet_replica.cc:330] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: stopping tablet replica
I20260809 02:00:13.152940 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29981
I20260809 02:00:13.152935 30452 tablet_replica.cc:330] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: stopping tablet replica
I20260809 02:00:13.154254 30450 raft_consensus.cc:2229] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:13.154683 30450 raft_consensus.cc:2258] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:13.156474 30450 ts_tablet_manager.cc:1905] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:13.159987 30450 ts_tablet_manager.cc:1918] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:13.160112 30450 log.cc:1196] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/c14fb69ba08e4fcc9e2b97412339bd31
I20260809 02:00:13.160455 30450 ts_tablet_manager.cc:1939] T c14fb69ba08e4fcc9e2b97412339bd31 P ee18bd5297b547c79a944d2fbcc3cc10: Deleting consensus metadata
I20260809 02:00:13.160449 30451 tablet_replica.cc:330] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: stopping tablet replica
I20260809 02:00:13.160842 30451 raft_consensus.cc:2229] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:00:13.161263 30451 raft_consensus.cc:2258] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:13.161720 29903 catalog_manager.cc:4841] TS ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573): tablet c14fb69ba08e4fcc9e2b97412339bd31 (table test-table [id=ddd89f2523574e1ca8a0c70273a6debf]) successfully deleted
W20260809 02:00:13.162470 29902 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:34843 (error 108)
I20260809 02:00:13.163025 30451 ts_tablet_manager.cc:1905] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:13.163338 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30122
I20260809 02:00:13.164083 30422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.163196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.0.0.1:60478)
0809 02:00:13.163938 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.164014 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":627}
I20260809 02:00:13.165897 30451 ts_tablet_manager.cc:1918] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:13.166014 30451 log.cc:1196] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/c14fb69ba08e4fcc9e2b97412339bd31
I20260809 02:00:13.166404 30451 ts_tablet_manager.cc:1939] T c14fb69ba08e4fcc9e2b97412339bd31 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting consensus metadata
I20260809 02:00:13.167616 29901 catalog_manager.cc:4841] TS 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081): tablet c14fb69ba08e4fcc9e2b97412339bd31 (table test-table [id=ddd89f2523574e1ca8a0c70273a6debf]) successfully deleted
W20260809 02:00:13.167626 29902 catalog_manager.cc:4584] TS a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c14fb69ba08e4fcc9e2b97412339bd31: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34843: connect: Connection refused (error 111)
I20260809 02:00:13.170492 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30265
I20260809 02:00:13.176345 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 29883
I20260809 02:00:13.184216 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--webserver_interface=127.14.175.254
--webserver_port=38775
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:43493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:13.303529 30454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:13.303831 30454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:13.303908 30454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:13.308465 30454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:13.308547 30454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:13.308591 30454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:13.308655 30454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:13.308701 30454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:13.314386 30454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:43493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=38775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:13.315498 30454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:13.316556 30454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:13.331007 30462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.331157 30454 server_base.cc:1034] running on GCE node
W20260809 02:00:13.331061 30463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:13.331249 30465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.331820 30454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:13.332850 30454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:13.334014 30454 hybrid_clock.cc:648] HybridClock initialized: now 1786240813333992 us; error 33 us; skew 500 ppm
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:13.336830 30454 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:13.337656 30454 webserver.cc:460] Webserver started at http://127.14.175.254:38775/ using document root <none> and password file <none>
I20260809 02:00:13.338219 30454 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:13.338292 30454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:13.342022 30454 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:13.344162 30472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.345364 30454 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:13.345510 30454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "85e8e2df9d8d4687a7922d4361c6dda5"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "5f7bf2dd5a7f9041f4c6df37c353312c"
server_key_iv: "8fef99f4f52459d960850c1e8b3fbfde"
server_key_version: "encryptionkey@0"
I20260809 02:00:13.346091 30454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:13.373458 30454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:13.376338 30454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:13.376549 30454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:13.383519 30454 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:43493
I20260809 02:00:13.383803 30530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:43493 every 8 connection(s)
I20260809 02:00:13.384639 30454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:13.388864 30531 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:00:13.390442 30531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap starting.
I20260809 02:00:13.391184 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30454
I20260809 02:00:13.391633 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:34843
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=41075
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:13.407779 30531 log.cc:824] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:13.416342 30531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:13.416713 30531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap complete.
I20260809 02:00:13.420835 30531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:13.421200 30531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Initialized, Role: FOLLOWER
I20260809 02:00:13.421680 30531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:13.421793 30531 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:13.421882 30531 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:13.421996 30531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:00:13.424010 30531 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:13.424372 30531 leader_election.cc:302] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85e8e2df9d8d4687a7922d4361c6dda5; no voters:
I20260809 02:00:13.424696 30531 leader_election.cc:288] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:00:13.424778 30536 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:00:13.424996 30536 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 LEADER]: Becoming Leader. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Running, Role: LEADER
I20260809 02:00:13.425277 30536 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:13.425971 30531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:13.426167 30537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:13.426275 30537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:13.426934 30538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85e8e2df9d8d4687a7922d4361c6dda5. Latest consensus state: current_term: 2 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:13.427062 30538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:13.427627 30540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:13.432228 30540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:13.432843 30540 catalog_manager.cc:1259] Loaded cluster ID: cd7fc2af67ce49d68d484e2289937012
I20260809 02:00:13.432922 30540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:13.434309 30540 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 02:00:13.439271 30540 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 02:00:13.444290 30540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:13.444990 30540 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Loaded TSK: 0
I20260809 02:00:13.446125 30540 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:00:13.506816 30534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:13.507171 30534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:13.507261 30534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:13.511411 30534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:13.511493 30534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:13.511596 30534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:13.516760 30534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:34843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=41075
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:13.517769 30534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:13.518720 30534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:13.529393 30561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.529490 30534 server_base.cc:1034] running on GCE node
W20260809 02:00:13.529624 30564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:13.529393 30562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.530088 30534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:13.530683 30534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:13.531863 30534 hybrid_clock.cc:648] HybridClock initialized: now 1786240813531841 us; error 38 us; skew 500 ppm
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:13.534611 30534 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:13.535713 30534 webserver.cc:460] Webserver started at http://127.14.175.193:41075/ using document root <none> and password file <none>
I20260809 02:00:13.536250 30534 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:13.536324 30534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:13.540369 30534 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:00:13.543076 30573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.544312 30534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:00:13.544409 30534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "0612ebb63f84deca1616aa29665d9360"
server_key_iv: "4f5caf0bbb9fb4558981e5bf1733378b"
server_key_version: "encryptionkey@0"
I20260809 02:00:13.544952 30534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:13.578297 30534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:13.581710 30534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:13.581920 30534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:13.582533 30534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:13.583653 30580 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:00:13.587765 30534 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:00:13.587821 30534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 02:00:13.587869 30534 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:00:13.589468 30534 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:00:13.589526 30534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:00:13.589792 30580 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap starting.
I20260809 02:00:13.600224 30534 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:34843
I20260809 02:00:13.600327 30693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:34843 every 8 connection(s)
I20260809 02:00:13.601188 30534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:13.609148 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30534
I20260809 02:00:13.609540 30580 log.cc:824] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:13.609598 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:44573
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=34817
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:13.618677 30580 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:13.618767 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.603361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:60929 (local address 127.14.175.254:43493)
0809 02:00:13.603866 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.603885 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.603999 (+ 114us) server_negotiation.cc:407] Connection header received
0809 02:00:13.605489 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.605500 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.605785 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.606040 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:13.607749 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.608712 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.610263 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.610887 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.611078 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.613733 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:13.613738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:13.613749 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:13.613775 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:13.615620 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.616164 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.616170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.616173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.616288 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.616647 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.616651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.616653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.616982 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:13.617139 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.617675 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.617934 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":158,"threads_started":1}
I20260809 02:00:13.619180 30580 tablet_bootstrap.cc:492] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap complete.
I20260809 02:00:13.619187 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.603290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:60929)
0809 02:00:13.603841 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.603898 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:13.605098 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:13.606199 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:13.606208 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:13.606732 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:13.607512 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.607541 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.608881 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.608885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.610123 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.610132 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.611093 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.611099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.611340 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.612058 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:13.612075 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:13.613514 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:13.615752 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.615758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.615770 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.616035 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.616391 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.616396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.616398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.616545 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.617135 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:13.617141 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:13.617361 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 02:00:13.617560 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 02:00:13.617884 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":133,"threads_started":1}
I20260809 02:00:13.620803 30580 ts_tablet_manager.cc:1397] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent bootstrapping tablet: real 0.031s user 0.018s sys 0.011s
I20260809 02:00:13.621413 30694 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:13.621658 30694 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:13.622146 30694 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
I20260809 02:00:13.624645 30490 ts_manager.cc:194] Registered new tserver with Master: a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:13.624246 30580 raft_consensus.cc:348] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:13.624744 30580 raft_consensus.cc:729] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a74eb668d6d34f1c8b0cbb0775af680d, State: Initialized, Role: FOLLOWER
I20260809 02:00:13.625196 30580 consensus_queue.cc:260] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:13.626112 30580 ts_tablet_manager.cc:1428] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260809 02:00:13.628497 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:60929
I20260809 02:00:13.630757 30694 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 02:00:13.638543 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.627800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.0.0.1:60486)
0809 02:00:13.628518 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.628562 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:13.628730 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:13.629366 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:13.629371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:13.629777 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:13.629901 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.629908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.631201 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.631205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.632202 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.632213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.632773 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.632777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.632894 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.633396 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:13.633410 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:13.634857 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:13.637002 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.637011 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.637016 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.637231 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.637544 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.637546 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.637547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.637620 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.638079 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:13.638083 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:13.638173 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 02:00:13.638279 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:00:13.638412 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":87,"threads_started":1}
I20260809 02:00:13.638700 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.627900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60486 (local address 127.14.175.193:34843)
0809 02:00:13.628645 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.628656 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.628679 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:00:13.628889 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.628894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.629077 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.629203 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:13.630041 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.631078 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.632326 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.632656 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.632741 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.635079 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:13.635089 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:13.635100 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:13.635123 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:13.636884 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.637348 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.637354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.637355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.637447 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.637705 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.637708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.637710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.637972 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:13.638097 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.638387 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.638549 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":75,"threads_started":1}
I20260809 02:00:13.639941 30624 tablet_service.cc:1514] Processing DeleteTablet for tablet c14fb69ba08e4fcc9e2b97412339bd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:13 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:60486
I20260809 02:00:13.640728 30705 tablet_replica.cc:330] stopping tablet replica
I20260809 02:00:13.641000 30705 raft_consensus.cc:2229] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:13.641227 30705 raft_consensus.cc:2258] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:13.642105 30705 ts_tablet_manager.cc:1905] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:13.645481 30705 ts_tablet_manager.cc:1918] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:13.645570 30705 log.cc:1196] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/c14fb69ba08e4fcc9e2b97412339bd31
I20260809 02:00:13.645877 30705 ts_tablet_manager.cc:1939] T c14fb69ba08e4fcc9e2b97412339bd31 P a74eb668d6d34f1c8b0cbb0775af680d: Deleting consensus metadata
I20260809 02:00:13.647367 30475 catalog_manager.cc:4841] TS a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843): tablet c14fb69ba08e4fcc9e2b97412339bd31 (table test-table [id=ddd89f2523574e1ca8a0c70273a6debf]) successfully deleted
W20260809 02:00:13.728945 30700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:13.729193 30700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:13.729269 30700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:13.733227 30700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:13.733309 30700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:13.733397 30700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:13.739112 30700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:44573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=34817
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:13.740063 30700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:13.741056 30700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:13.750638 30715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:13.750676 30713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.750785 30700 server_base.cc:1034] running on GCE node
W20260809 02:00:13.750674 30712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.751328 30700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:13.751933 30700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:13.753118 30700 hybrid_clock.cc:648] HybridClock initialized: now 1786240813753085 us; error 44 us; skew 500 ppm
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:13.755762 30700 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:13.756561 30700 webserver.cc:460] Webserver started at http://127.14.175.194:34817/ using document root <none> and password file <none>
I20260809 02:00:13.757126 30700 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:13.757241 30700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:13.760799 30700 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:00:13.762719 30723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.764005 30700 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:13.764156 30700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "79751eeca335ff28695d9b07c1f16d90"
server_key_iv: "e983ac0276752bd615a9a9022993d7f0"
server_key_version: "encryptionkey@0"
I20260809 02:00:13.764707 30700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:13.793643 30700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:13.796591 30700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:13.796805 30700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:13.797433 30700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:13.798256 30700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:13.798329 30700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.798401 30700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:13.798452 30700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.807106 30700 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44573
I20260809 02:00:13.807199 30842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44573 every 8 connection(s)
I20260809 02:00:13.808233 30700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:13.817905 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30700
I20260809 02:00:13.818332 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:41081
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=35815
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:13.821768 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.810121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:47487 (local address 127.14.175.254:43493)
0809 02:00:13.810273 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:13.810277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:13.811072 (+ 795us) server_negotiation.cc:407] Connection header received
0809 02:00:13.812373 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:13.812375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:13.812424 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:13.812497 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:13.813592 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.814133 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.815280 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.815514 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.815596 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.817866 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:13.817869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:13.817871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:13.817895 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:13.819488 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.820125 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.820130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.820133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.820233 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:13.820568 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:13.820573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:13.820576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:13.820819 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:13.820930 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:13.821368 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 02:00:13.821518 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:00:13.822325 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:13.810475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:47487)
0809 02:00:13.810896 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:13.810936 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:13.812188 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:13.812664 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:13.812670 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:13.813023 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:13.813467 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.813480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.814242 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.814244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.815176 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:13.815185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:13.815640 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:13.815643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:13.815769 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:13.816264 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:13.816279 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:13.817681 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:13.819603 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.819612 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.819628 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.820007 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.820335 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:13.820338 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:13.820339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:13.820465 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:13.820928 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:13.820932 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:13.821140 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 02:00:13.821286 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 02:00:13.821516 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":112,"threads_started":1}
I20260809 02:00:13.823659 30843 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:13.823915 30843 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:13.824517 30843 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
I20260809 02:00:13.825793 30490 ts_manager.cc:194] Registered new tserver with Master: ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573)
I20260809 02:00:13.826670 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:47487
W20260809 02:00:13.932086 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:13.932335 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:13.932380 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:13.936425 30846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:13.936480 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:13.936537 30846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:13.941709 30846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:41081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=35815
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:13.942677 30846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:13.943672 30846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:13.953720 30854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:13.953724 30853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:13.953722 30856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:13.953856 30846 server_base.cc:1034] running on GCE node
I20260809 02:00:13.954701 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:13.955504 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:13.956693 30846 hybrid_clock.cc:648] HybridClock initialized: now 1786240813956659 us; error 42 us; skew 500 ppm
Aug 09 02:00:13 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:13.963403 30846 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:13.964711 30846 webserver.cc:460] Webserver started at http://127.14.175.195:35815/ using document root <none> and password file <none>
I20260809 02:00:13.965337 30846 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:13.965452 30846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:13.970664 30846 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:00:13.973501 30863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:13.975335 30846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 02:00:13.975507 30846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1d00d6bd8d35438a93e0822c58b1970c"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "64a63a2831880116b0b42bbd4b386bf1"
server_key_iv: "e1dcbcd2fbc12884c0d87c8c3a1f3482"
server_key_version: "encryptionkey@0"
I20260809 02:00:13.976186 30846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:14.008852 30846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:14.013190 30846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:14.013417 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:14.014169 30846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:14.015355 30846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:14.015434 30846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:14.015513 30846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:14.015547 30846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:14.024757 30846 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:41081
I20260809 02:00:14.024781 30988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:41081 every 8 connection(s)
I20260809 02:00:14.025730 30846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:14.027205 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 30846
Aug 09 02:00:14 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240813, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:14.037461 30993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.028862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43884 (local address 127.14.175.254:43493)
0809 02:00:14.029100 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.029103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.029116 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:00:14.029155 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.029157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.029213 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.029293 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:14.030220 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.030825 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.031958 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.032305 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.032420 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.033986 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:14.033989 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:14.033992 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:14.034026 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:14.035670 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:14.036196 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:14.036201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:14.036202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:14.036287 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:14.036582 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:14.036587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:14.036588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:14.036824 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:14.037020 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.037199 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.037293 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
I20260809 02:00:14.040828 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.028797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:56751 (local address 127.14.175.254:43493)
0809 02:00:14.028973 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.028979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.029002 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:00:14.030220 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.030223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.030261 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.030341 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:14.031688 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.032323 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.033985 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.034340 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.034433 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.037609 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:14.037612 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:14.037615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:14.037638 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:14.039166 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:14.039640 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:14.039642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:14.039643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:14.039713 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:14.040006 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:14.040009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:14.040010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:14.040154 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:14.040224 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.040639 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.040725 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:00:14.041656 30992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.027972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:56751)
0809 02:00:14.028437 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.028477 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.029997 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.030491 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:14.030498 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:14.030816 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:14.031533 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.031551 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.032442 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.032446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.033872 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.033886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.034495 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.034500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.034696 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.035384 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:14.035398 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:14.037318 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:14.039290 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:14.039294 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:14.039305 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:14.039555 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:14.039792 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:14.039794 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:14.039796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:14.039920 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:14.040238 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:14.040242 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:14.040445 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 02:00:14.040593 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:00:14.040820 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":99,"threads_started":1}
I20260809 02:00:14.042735 30989 heartbeater.cc:347] Connected to a master server at 127.14.175.254:43493
I20260809 02:00:14.042936 30989 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:14.043409 30989 heartbeater.cc:511] Master 127.14.175.254:43493 requested a full tablet report, sending...
I20260809 02:00:14.044500 30490 ts_manager.cc:194] Registered new tserver with Master: 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081)
I20260809 02:00:14.045065 30490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:56751
I20260809 02:00:14.050917 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:14.055322 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.051555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43894 (local address 127.14.175.254:43493)
0809 02:00:14.051702 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.051707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.051878 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:00:14.052066 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.052068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.052155 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.052261 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:14.052517 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.052992 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.053890 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.054108 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.054218 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.054533 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:14.054886 (+ 353us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:14.055045 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.055134 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.055186 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:00:14.055907 30490 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43894:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:00:14.059056 30490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:00:14.066284 30624 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 (DEFAULT_TABLE table=test-table [id=57d4b48b5e584cafa3a27c6f5f62f975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:14.066929 30624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4133d0039431b8ff110cf1cb518a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:14.069906 30580 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap starting.
I20260809 02:00:14.070581 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.065731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:41081 (local address 127.0.0.1:35814)
0809 02:00:14.066172 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.066186 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.066276 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.067008 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:14.067010 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:14.067028 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:14.067123 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.067129 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.068321 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.068327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.069192 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.069203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.070165 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.070169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.070253 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.070319 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 02:00:14.070386 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:00:14.070453 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":93,"threads_started":1}
I20260809 02:00:14.070724 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.065187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44573 (local address 127.0.0.1:37116)
0809 02:00:14.065302 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.065317 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.065417 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.066450 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:14.066455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:14.066476 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:14.066567 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.066573 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.068100 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.068104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.069247 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.069260 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.070349 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.070352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.070446 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.070467 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:00:14.070530 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:00:14.070610 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:00:14.070791 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.065524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.14.175.194:44573)
0809 02:00:14.065936 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.065950 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.065973 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:00:14.066050 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.066055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.066255 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.066467 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:14.066665 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.067746 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.069395 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.070197 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.070363 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.070490 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.070568 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.070653 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":192,"threads_started":1}
I20260809 02:00:14.070819 30580 tablet_bootstrap.cc:654] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:14.072153 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.066079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35814 (local address 127.14.175.195:41081)
0809 02:00:14.066629 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.066644 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.066666 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:00:14.066728 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.066734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.066867 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.067122 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:14.067260 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.068172 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.069336 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.070036 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.071286 (+ 1250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.071437 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.071760 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.071881 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":154,"threads_started":1}
I20260809 02:00:14.072263 30580 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: No bootstrap required, opened a new log
I20260809 02:00:14.072346 30580 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:14.072779 30580 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.072914 30580 raft_consensus.cc:374] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:14.072963 30580 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a74eb668d6d34f1c8b0cbb0775af680d, State: Initialized, Role: FOLLOWER
I20260809 02:00:14.073093 30580 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.073367 30580 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:00:14.073729 30774 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 (DEFAULT_TABLE table=test-table [id=57d4b48b5e584cafa3a27c6f5f62f975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:14.074863 30774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4133d0039431b8ff110cf1cb518a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:14.074749 30915 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 (DEFAULT_TABLE table=test-table [id=57d4b48b5e584cafa3a27c6f5f62f975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:14.075793 30915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4133d0039431b8ff110cf1cb518a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:14.083009 31002 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Bootstrap starting.
I20260809 02:00:14.083005 31003 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Bootstrap starting.
I20260809 02:00:14.085701 31002 tablet_bootstrap.cc:654] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:14.085701 31003 tablet_bootstrap.cc:654] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:14.086585 31003 log.cc:824] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:14.086585 31002 log.cc:824] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:14.088682 31003 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: No bootstrap required, opened a new log
I20260809 02:00:14.088675 31002 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: No bootstrap required, opened a new log
I20260809 02:00:14.088873 31002 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 02:00:14.088865 31003 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 02:00:14.092720 31002 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.092720 31003 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.092978 31003 raft_consensus.cc:374] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:14.092978 31002 raft_consensus.cc:374] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:14.093039 31002 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee18bd5297b547c79a944d2fbcc3cc10, State: Initialized, Role: FOLLOWER
I20260809 02:00:14.093048 31003 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d00d6bd8d35438a93e0822c58b1970c, State: Initialized, Role: FOLLOWER
I20260809 02:00:14.093489 31003 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.093489 31002 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.094134 30989 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
I20260809 02:00:14.094326 30843 heartbeater.cc:503] Master 127.14.175.254:43493 was elected leader, sending a full tablet report...
I20260809 02:00:14.094460 31002 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260809 02:00:14.094460 31003 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260809 02:00:14.102325 30695 tablet.cc:2369] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:14.266003 31007 raft_consensus.cc:482] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:14.266250 31007 raft_consensus.cc:504] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.267468 31007 leader_election.cc:288] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:14.271584 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.267805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:46311 (local address 127.14.175.195:41081)
0809 02:00:14.267996 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.268003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.268033 (+ 30us) server_negotiation.cc:407] Connection header received
0809 02:00:14.268107 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.268109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.268151 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.268259 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:14.268541 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.269052 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.270386 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.271053 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.271198 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.271250 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.271427 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.271487 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:00:14.271624 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.267708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:41081 (local address 127.14.175.194:46311)
0809 02:00:14.267823 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.267838 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.267940 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.268292 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:14.268294 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:14.268312 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:14.268416 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.268420 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.269170 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.269173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.270253 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.270262 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.271188 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.271192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.271300 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.271325 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:00:14.271406 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:00:14.271478 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:00:14.272248 30937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d00d6bd8d35438a93e0822c58b1970c" is_pre_election: true
I20260809 02:00:14.272365 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.267712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.14.175.194:36203)
0809 02:00:14.268327 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.268340 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.268471 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.268816 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:14.268819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:14.268835 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:14.268965 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.268972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.269974 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.269976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.271077 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:14.271088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.271981 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.271985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:14.272080 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.272100 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:00:14.272162 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 02:00:14.272231 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":321,"thread_start_us":85,"threads_started":1}
I20260809 02:00:14.272382 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.267843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:36203 (local address 127.14.175.193:34843)
0809 02:00:14.268183 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.268188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.268435 (+ 247us) server_negotiation.cc:407] Connection header received
0809 02:00:14.268594 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.268602 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.268688 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.268807 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:14.269090 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.269857 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.271203 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.271866 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.271986 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.272157 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.272195 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.272261 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":129,"threads_started":1}
I20260809 02:00:14.272617 30937 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 0.
I20260809 02:00:14.273032 30645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" is_pre_election: true
I20260809 02:00:14.273133 30725 leader_election.cc:302] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d00d6bd8d35438a93e0822c58b1970c, ee18bd5297b547c79a944d2fbcc3cc10; no voters:
I20260809 02:00:14.273327 30645 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 0.
I20260809 02:00:14.273396 31007 raft_consensus.cc:2781] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:14.273535 31007 raft_consensus.cc:482] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:14.273597 31007 raft_consensus.cc:3037] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:14.274698 31007 raft_consensus.cc:504] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.275139 31007 leader_election.cc:288] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 1 election: Requested vote from peers 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:14.275511 30937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d00d6bd8d35438a93e0822c58b1970c"
I20260809 02:00:14.275583 30645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
I20260809 02:00:14.275658 30937 raft_consensus.cc:3037] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:14.275718 30645 raft_consensus.cc:3037] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 0 FOLLOWER]: Advancing to term 1
W20260809 02:00:14.276670 30990 tablet.cc:2369] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:14.276675 30937 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 1.
I20260809 02:00:14.276856 30645 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 1.
I20260809 02:00:14.277015 30725 leader_election.cc:302] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d00d6bd8d35438a93e0822c58b1970c, ee18bd5297b547c79a944d2fbcc3cc10; no voters:
I20260809 02:00:14.277168 31007 raft_consensus.cc:2781] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:14.277396 31007 raft_consensus.cc:686] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 LEADER]: Becoming Leader. State: Replica: ee18bd5297b547c79a944d2fbcc3cc10, State: Running, Role: LEADER
I20260809 02:00:14.277725 31007 consensus_queue.cc:237] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.280809 30488 catalog_manager.cc:5495] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } health_report { overall_health: UNKNOWN } } }
I20260809 02:00:14.307325 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.303790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37130 (local address 127.14.175.194:44573)
0809 02:00:14.303957 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:14.303961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:14.303978 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:00:14.304071 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:14.304074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:14.304127 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:14.304243 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:14.304492 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.304991 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.305844 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:14.306065 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:14.306179 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:14.306497 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:14.306893 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:14.307076 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:14.307130 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:00:14.307184 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260809 02:00:14.309337 30844 tablet.cc:2369] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:00:14.313259 30645 raft_consensus.cc:1261] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Refusing update from remote peer ee18bd5297b547c79a944d2fbcc3cc10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:14.313271 30937 raft_consensus.cc:1261] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Refusing update from remote peer ee18bd5297b547c79a944d2fbcc3cc10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:14.313953 31010 consensus_queue.cc:1035] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:14.314139 31007 consensus_queue.cc:1035] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:14.320763 31014 mvcc.cc:205] Tried to move back new op lower bound from 7316442375419547648 to 7316442375284203520. Current Snapshot: MvccSnapshot[applied={T|T < 7316442375419547648}]
I20260809 02:00:14.320894 31015 mvcc.cc:205] Tried to move back new op lower bound from 7316442375419547648 to 7316442375284203520. Current Snapshot: MvccSnapshot[applied={T|T < 7316442375419547648}]
I20260809 02:00:14.328855 30488 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:14.329041 30488 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:14.331414 30488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Sending DeleteTablet for 3 replicas of tablet 0df4133d0039431b8ff110cf1cb518a6
I20260809 02:00:14.332074 30915 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:14 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:35814
I20260809 02:00:14.332070 30774 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:14 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:37116
I20260809 02:00:14.332216 30624 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4133d0039431b8ff110cf1cb518a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:14 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:60486
I20260809 02:00:14.332543 31027 tablet_replica.cc:330] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: stopping tablet replica
I20260809 02:00:14.332593 31026 tablet_replica.cc:330] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: stopping tablet replica
I20260809 02:00:14.332674 31027 raft_consensus.cc:2229] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:14.332794 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30534
I20260809 02:00:14.332795 31027 raft_consensus.cc:2258] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:14.334699 31026 raft_consensus.cc:2229] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:14.334985 31026 raft_consensus.cc:2258] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:14.336411 31026 ts_tablet_manager.cc:1905] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:14.339242 31026 ts_tablet_manager.cc:1918] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:14.339345 31026 log.cc:1196] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/0df4133d0039431b8ff110cf1cb518a6
I20260809 02:00:14.339285 31025 tablet_replica.cc:330] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: stopping tablet replica
I20260809 02:00:14.339723 31026 ts_tablet_manager.cc:1939] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Deleting consensus metadata
I20260809 02:00:14.339751 31025 raft_consensus.cc:2229] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:00:14.340219 31025 raft_consensus.cc:2258] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:14.341038 30474 catalog_manager.cc:4841] TS 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081): tablet 0df4133d0039431b8ff110cf1cb518a6 (table test-table [id=57d4b48b5e584cafa3a27c6f5f62f975]) successfully deleted
W20260809 02:00:14.344529 30475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:34843 (error 108)
I20260809 02:00:14.344806 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30700
I20260809 02:00:14.346318 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.345465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.0.0.1:60500)
0809 02:00:14.346185 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.346250 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":643}
W20260809 02:00:14.346477 30475 catalog_manager.cc:4584] TS a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0df4133d0039431b8ff110cf1cb518a6: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34843: connect: Connection refused (error 111)
I20260809 02:00:14.352571 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30846
I20260809 02:00:14.354000 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.352792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44573 (local address 127.0.0.1:37138)
0809 02:00:14.353854 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.353914 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.194:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":976}
I20260809 02:00:14.359258 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 30454
I20260809 02:00:14.366792 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--webserver_interface=127.14.175.254
--webserver_port=38775
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:43493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:14.475108 31029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:14.475358 31029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:14.475399 31029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:14.479476 31029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:14.479537 31029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:14.479557 31029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:14.479573 31029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:14.479611 31029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:14.484997 31029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:43493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=38775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:14.486061 31029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:14.487110 31029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:14.495545 31037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:14.495605 31029 server_base.cc:1034] running on GCE node
W20260809 02:00:14.495566 31039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:14.495563 31036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:14.496320 31029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:14.497314 31029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:14.498476 31029 hybrid_clock.cc:648] HybridClock initialized: now 1786240814498464 us; error 23 us; skew 500 ppm
Aug 09 02:00:14 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240814, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:14.501320 31029 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:14.502185 31029 webserver.cc:460] Webserver started at http://127.14.175.254:38775/ using document root <none> and password file <none>
I20260809 02:00:14.502740 31029 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:14.502816 31029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:14.506521 31029 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:00:14.508613 31046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:14.509793 31029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:14.509934 31029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "85e8e2df9d8d4687a7922d4361c6dda5"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "5f7bf2dd5a7f9041f4c6df37c353312c"
server_key_iv: "8fef99f4f52459d960850c1e8b3fbfde"
server_key_version: "encryptionkey@0"
I20260809 02:00:14.510479 31029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:14.535115 31029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:14.538349 31029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:14.538564 31029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:14.546439 31029 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:43493
I20260809 02:00:14.546720 31100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:43493 every 8 connection(s)
I20260809 02:00:14.547597 31029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:14.551631 31101 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:00:14.553185 31101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap starting.
I20260809 02:00:14.553623 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31029
I20260809 02:00:14.554103 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:34843
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=41075
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:14.572221 31101 log.cc:824] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:14.583454 31101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:14.583845 31101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5: Bootstrap complete.
I20260809 02:00:14.588016 31101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:14.588411 31101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Initialized, Role: FOLLOWER
I20260809 02:00:14.588937 31101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:14.589076 31101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:14.589159 31101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:14.589255 31101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:00:14.591212 31101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:14.591588 31101 leader_election.cc:302] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85e8e2df9d8d4687a7922d4361c6dda5; no voters:
I20260809 02:00:14.591993 31101 leader_election.cc:288] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:00:14.592125 31105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:00:14.592373 31105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [term 3 LEADER]: Becoming Leader. State: Replica: 85e8e2df9d8d4687a7922d4361c6dda5, State: Running, Role: LEADER
I20260809 02:00:14.592661 31105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } }
I20260809 02:00:14.593240 31101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:14.593605 31105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85e8e2df9d8d4687a7922d4361c6dda5. Latest consensus state: current_term: 3 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:14.593724 31105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:14.594467 31106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e8e2df9d8d4687a7922d4361c6dda5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 43493 } } }
I20260809 02:00:14.594596 31106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e8e2df9d8d4687a7922d4361c6dda5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:14.594935 31110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:14.600178 31110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:14.600870 31110 catalog_manager.cc:1259] Loaded cluster ID: cd7fc2af67ce49d68d484e2289937012
I20260809 02:00:14.600950 31110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 02:00:14.601817 31110 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4e33c7a9ad google::LogMessage::Fail() at ??:0
@ 0x7f4e33c7d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f4e33c7a4de google::LogMessage::Flush() at ??:0
@ 0x7f4e33c7ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4e3e5b9fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f4e3e5bad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4e3e5b7579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f4e3e5fb640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4e35ecc3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4e35eccc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f4e35ece3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4e35ebd512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4e375016db start_thread at ??:0
@ 0x7f4e3277861f clone at ??:0
W20260809 02:00:14.687078 31103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:14.687328 31103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:14.687408 31103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:14.691525 31103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:14.691597 31103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:14.691700 31103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:14.696911 31103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:34843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=41075
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:14.697927 31103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:14.698918 31103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:14.708508 31144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:14.708513 31145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:14.708595 31103 server_base.cc:1034] running on GCE node
W20260809 02:00:14.708899 31148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:14.709335 31103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:14.709990 31103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:14.711182 31103 hybrid_clock.cc:648] HybridClock initialized: now 1786240814711161 us; error 31 us; skew 500 ppm
Aug 09 02:00:14 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240814, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:14.714037 31103 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:14.714941 31103 webserver.cc:460] Webserver started at http://127.14.175.193:41075/ using document root <none> and password file <none>
I20260809 02:00:14.715538 31103 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:14.715601 31103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:14.719370 31103 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:00:14.721560 31156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:14.722886 31103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:14.723084 31103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "0612ebb63f84deca1616aa29665d9360"
server_key_iv: "4f5caf0bbb9fb4558981e5bf1733378b"
server_key_version: "encryptionkey@0"
I20260809 02:00:14.723628 31103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:14.738152 31103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:14.741223 31103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:14.741413 31103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:14.741974 31103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:14.743088 31164 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:00:14.748199 31103 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:00:14.748279 31103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:00:14.748371 31103 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:00:14.749938 31103 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:00:14.750003 31103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:00:14.750293 31164 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap starting.
I20260809 02:00:14.761093 31103 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:34843
I20260809 02:00:14.761345 31282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:34843 every 8 connection(s)
I20260809 02:00:14.762212 31103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:14.771814 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31103
I20260809 02:00:14.772281 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:44573
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=34817
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:14.773330 31164 log.cc:824] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:14.780171 31164 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:14.780529 31164 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Bootstrap complete.
I20260809 02:00:14.781690 31164 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent bootstrapping tablet: real 0.032s user 0.020s sys 0.008s
I20260809 02:00:14.783985 31164 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.784397 31164 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a74eb668d6d34f1c8b0cbb0775af680d, State: Initialized, Role: FOLLOWER
I20260809 02:00:14.784857 31164 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:14.785640 31164 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d: Time spent starting tablet: real 0.004s user 0.002s sys 0.004s
W20260809 02:00:14.840654 31285 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:00:14.764279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:55501)
0809 02:00:14.764805 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.764862 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:14.765664 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:14.839860 (+ 74196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":150,"threads_started":1}
W20260809 02:00:14.841252 31283 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:43493 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:43493: Client connection negotiation failed: client connection to 127.14.175.254:43493: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:00:14.841997 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.841732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:41613)
0809 02:00:14.841859 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.841930 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:00:14.842717 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.842518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:51043)
0809 02:00:14.842621 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.842673 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:00:14.842911 31283 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:00:14.906208 31287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:14.906476 31287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:14.906551 31287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:14.910558 31287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:14.910630 31287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:14.910717 31287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:14.915935 31287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:44573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=34817
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:14.916929 31287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:14.917960 31287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:14.927547 31295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:14.927554 31297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:14.927563 31294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:14.927726 31287 server_base.cc:1034] running on GCE node
I20260809 02:00:14.928352 31287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:14.928898 31287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:14.930059 31287 hybrid_clock.cc:648] HybridClock initialized: now 1786240814930041 us; error 30 us; skew 500 ppm
Aug 09 02:00:14 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240814, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:14.932710 31287 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:14.933521 31287 webserver.cc:460] Webserver started at http://127.14.175.194:34817/ using document root <none> and password file <none>
I20260809 02:00:14.934036 31287 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:14.934099 31287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:14.938294 31287 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:00:14.940327 31306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:14.941466 31287 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:14.941587 31287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "ee18bd5297b547c79a944d2fbcc3cc10"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "79751eeca335ff28695d9b07c1f16d90"
server_key_iv: "e983ac0276752bd615a9a9022993d7f0"
server_key_version: "encryptionkey@0"
I20260809 02:00:14.942121 31287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:14.955638 31287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:14.958783 31287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:14.959028 31287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:14.959618 31287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:14.960676 31313 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:00:14.964702 31287 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:00:14.964766 31287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 02:00:14.964861 31287 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:00:14.966470 31287 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:00:14.966514 31287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:00:14.966778 31313 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Bootstrap starting.
I20260809 02:00:14.977172 31287 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:44573
I20260809 02:00:14.977265 31425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:44573 every 8 connection(s)
I20260809 02:00:14.978144 31287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:00:14.981053 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31287
I20260809 02:00:14.981398 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.980002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:44417)
0809 02:00:14.980487 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.980622 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":148,"threads_started":1}
I20260809 02:00:14.981648 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:41081
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:43493
--webserver_port=35815
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:41291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:14.981814 31426 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:43493 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:43493: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
I20260809 02:00:14.982405 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.982153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:34581)
0809 02:00:14.982270 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.982333 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:00:14.983045 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:14.982812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:42387)
0809 02:00:14.982915 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:14.982990 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 02:00:14.983227 31426 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:00:14.987004 31313 log.cc:824] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:14.996698 31313 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:14.997119 31313 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Bootstrap complete.
I20260809 02:00:14.998710 31313 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.014s
I20260809 02:00:15.002305 31313 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:15.003000 31313 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee18bd5297b547c79a944d2fbcc3cc10, State: Initialized, Role: FOLLOWER
I20260809 02:00:15.003496 31313 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:15.004482 31313 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Time spent starting tablet: real 0.006s user 0.008s sys 0.001s
I20260809 02:00:15.004709 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.004429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:56589)
0809 02:00:15.004567 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.004631 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 02:00:15.005409 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.005217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:38681)
0809 02:00:15.005315 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.005359 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:00:15.102684 31430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:15.102938 31430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:15.103048 31430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:15.107129 31430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:15.107185 31430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:15.107293 31430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:15.112520 31430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:41291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:41081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=35815
--tserver_master_addrs=127.14.175.254:43493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:15.113484 31430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:15.114456 31430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:15.123934 31437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:15.123920 31438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:15.124303 31440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:15.124275 31430 server_base.cc:1034] running on GCE node
I20260809 02:00:15.124689 31430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:15.125360 31430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:15.126561 31430 hybrid_clock.cc:648] HybridClock initialized: now 1786240815126543 us; error 31 us; skew 500 ppm
Aug 09 02:00:15 dist-test-slave-2w3w krb5kdc[29869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240815, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:15.129380 31430 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:15.130151 31430 webserver.cc:460] Webserver started at http://127.14.175.195:35815/ using document root <none> and password file <none>
I20260809 02:00:15.130645 31430 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:15.130707 31430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:15.134389 31430 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:15.136541 31448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:15.137737 31430 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:15.137859 31430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1d00d6bd8d35438a93e0822c58b1970c"
format_stamp: "Formatted at 2026-08-09 02:00:12 on dist-test-slave-2w3w"
server_key: "64a63a2831880116b0b42bbd4b386bf1"
server_key_iv: "e1dcbcd2fbc12884c0d87c8c3a1f3482"
server_key_version: "encryptionkey@0"
I20260809 02:00:15.138384 31430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:15.149780 31430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:15.152464 31430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:15.152653 31430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:15.153208 31430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:15.153988 31430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:15.154035 31430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:15.154101 31430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:15.154139 31430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:15.163053 31430 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:41081
I20260809 02:00:15.163085 31569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:41081 every 8 connection(s)
I20260809 02:00:15.164021 31430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:15.167753 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.166090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:44397)
0809 02:00:15.166539 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.167060 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":105,"threads_started":1}
W20260809 02:00:15.168167 31570 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:43493 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:43493: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
I20260809 02:00:15.168730 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.168534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:56795)
0809 02:00:15.168635 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.168681 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:00:15.169304 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.169130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:46113)
0809 02:00:15.169220 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.169261 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:00:15.169469 31570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:00:15.169693 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31430
I20260809 02:00:15.843928 31574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:15.843468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:36765)
0809 02:00:15.843726 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:15.843783 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":78,"threads_started":1}
I20260809 02:00:16.006706 31575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.006257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:59479)
0809 02:00:16.006546 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.006608 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":75,"threads_started":1}
I20260809 02:00:16.170457 31576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.170063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:56935)
0809 02:00:16.170310 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.170364 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
I20260809 02:00:16.396961 31577 raft_consensus.cc:482] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:16.397213 31577 raft_consensus.cc:504] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:16.398370 31577 leader_election.cc:288] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
Aug 09 02:00:16 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240814, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
Aug 09 02:00:16 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240814, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.195@KRBTEST.COM
I20260809 02:00:16.411554 31578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.398588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:41081 (local address 127.14.175.194:57929)
0809 02:00:16.399035 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.399050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:16.399453 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:16.400694 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:16.400697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:16.400895 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:16.401167 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:16.401176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.402407 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.402410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:16.403407 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:16.403416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.404105 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.404108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:16.404324 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:16.404964 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:16.404981 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:16.406835 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:16.409152 (+ 2317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409159 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:16.409161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:16.409361 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:16.409775 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:16.409779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:16.409863 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:16.410561 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:16.410567 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:16.410793 (+ 226us) client_negotiation.cc:769] Sending connection context
0809 02:00:16.410997 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 02:00:16.411346 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":218,"spinlock_wait_cycles":38784,"thread_start_us":70,"threads_started":1}
I20260809 02:00:16.411552 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.398863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:57929 (local address 127.14.175.195:41081)
0809 02:00:16.399536 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:16.399559 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:16.399600 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:00:16.400248 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:16.400253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:16.400496 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:16.400749 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:16.401327 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.402269 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.403537 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.403977 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.404150 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:16.407092 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:16.407096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:16.407129 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:16.407166 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:16.409033 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409478 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:16.409483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:16.409488 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:16.409657 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409961 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:16.409964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:16.409966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:16.410434 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:16.410583 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:16.411126 (+ 543us) server_negotiation.cc:299] Negotiation successful
0809 02:00:16.411374 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":128,"threads_started":1}
I20260809 02:00:16.411553 31579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.398832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:38653 (local address 127.14.175.193:34843)
0809 02:00:16.399298 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:16.399306 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:16.399431 (+ 125us) server_negotiation.cc:407] Connection header received
0809 02:00:16.399763 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:16.399767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:16.399962 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:16.400162 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:16.401336 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.402284 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.403510 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.403966 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.404151 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:16.406711 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:16.406716 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:16.406728 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:16.406753 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:16.408674 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409191 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:16.409203 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:16.409207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:16.409332 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409714 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:16.409719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:16.409721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:16.410446 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:16.410586 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:16.411121 (+ 535us) server_negotiation.cc:299] Negotiation successful
0809 02:00:16.411375 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":72,"threads_started":1}
I20260809 02:00:16.411589 31575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.398579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34843 (local address 127.14.175.194:38653)
0809 02:00:16.398871 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.398907 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:16.399411 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:16.400248 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:16.400257 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:16.400740 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:16.401162 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:16.401175 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.402415 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.402420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:16.403384 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:16.403394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:16.404105 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:16.404108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:16.404351 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:16.405020 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:16.405032 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:16.406488 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:16.408795 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:16.408802 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:16.408815 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:16.409072 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:16.409438 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:16.409441 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:16.409443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:16.409604 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:16.410561 (+ 957us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:16.410567 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:16.410793 (+ 226us) client_negotiation.cc:769] Sending connection context
0809 02:00:16.411007 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 02:00:16.411438 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":275,"spinlock_wait_cycles":13952}
I20260809 02:00:16.413511 31230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" is_pre_election: true
I20260809 02:00:16.413844 31230 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 1.
I20260809 02:00:16.414721 31309 leader_election.cc:302] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a74eb668d6d34f1c8b0cbb0775af680d, ee18bd5297b547c79a944d2fbcc3cc10; no voters:
W20260809 02:00:16.414932 31308 leader_election.cc:341] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081): Not found: Tablet not found: 0df4133d0039431b8ff110cf1cb518a6
I20260809 02:00:16.415077 31577 raft_consensus.cc:2781] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:00:16.415194 31577 raft_consensus.cc:482] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:16.415253 31577 raft_consensus.cc:3037] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:00:16.417361 31577 raft_consensus.cc:504] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:16.417745 31577 leader_election.cc:288] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 election: Requested vote from peers 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081), a74eb668d6d34f1c8b0cbb0775af680d (127.14.175.193:34843)
I20260809 02:00:16.418232 31230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4133d0039431b8ff110cf1cb518a6" candidate_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a74eb668d6d34f1c8b0cbb0775af680d"
I20260809 02:00:16.418385 31230 raft_consensus.cc:3037] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 1 FOLLOWER]: Advancing to term 2
W20260809 02:00:16.418543 31308 leader_election.cc:341] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081): Not found: Tablet not found: 0df4133d0039431b8ff110cf1cb518a6
I20260809 02:00:16.420588 31230 raft_consensus.cc:2454] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee18bd5297b547c79a944d2fbcc3cc10 in term 2.
I20260809 02:00:16.420964 31309 leader_election.cc:302] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a74eb668d6d34f1c8b0cbb0775af680d, ee18bd5297b547c79a944d2fbcc3cc10; no voters: 1d00d6bd8d35438a93e0822c58b1970c
I20260809 02:00:16.421236 31577 raft_consensus.cc:2781] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:00:16.421407 31577 raft_consensus.cc:686] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [term 2 LEADER]: Becoming Leader. State: Replica: ee18bd5297b547c79a944d2fbcc3cc10, State: Running, Role: LEADER
I20260809 02:00:16.421744 31577 consensus_queue.cc:237] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:16.422117 31575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.421854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:49807)
0809 02:00:16.421978 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.422043 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 02:00:16.845052 31583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.844656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:35747)
0809 02:00:16.844903 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.844958 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
W20260809 02:00:16.989878 31308 consensus_peers.cc:487] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 -> Peer 1d00d6bd8d35438a93e0822c58b1970c (127.14.175.195:41081): Couldn't send request to peer 1d00d6bd8d35438a93e0822c58b1970c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0df4133d0039431b8ff110cf1cb518a6. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:00:16.990760 31230 raft_consensus.cc:1261] T 0df4133d0039431b8ff110cf1cb518a6 P a74eb668d6d34f1c8b0cbb0775af680d [term 2 FOLLOWER]: Refusing update from remote peer ee18bd5297b547c79a944d2fbcc3cc10: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260809 02:00:16.991458 31584 consensus_queue.cc:1035] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260809 02:00:16.993402 31583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.993130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:58979)
0809 02:00:16.993271 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.993335 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 02:00:16.996007 31590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.995631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:43279)
0809 02:00:16.995838 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.995915 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":73,"threads_started":1}
I20260809 02:00:16.996217 31583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:16.995907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:51081)
0809 02:00:16.995999 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:16.996050 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:00:17.171610 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.171198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:50569)
0809 02:00:17.171448 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.171502 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":102,"threads_started":1}
I20260809 02:00:17.459259 31593 ts_tablet_manager.cc:927] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Initiating tablet copy from peer ee18bd5297b547c79a944d2fbcc3cc10 (127.14.175.194:44573)
I20260809 02:00:17.459865 31593 tablet_copy_client.cc:316] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.175.194:44573
Aug 09 02:00:17 dist-test-slave-2w3w krb5kdc[29869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240815, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.194@KRBTEST.COM
I20260809 02:00:17.473816 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.460393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:44573 (local address 127.14.175.195:59477)
0809 02:00:17.460559 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.460579 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:17.460742 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:17.461539 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:17.461545 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:17.461931 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:17.462052 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:17.462059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:17.463069 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:17.463072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:17.463703 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:17.463711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:17.464261 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:17.464264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:17.464342 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:17.468845 (+ 4503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:17.468861 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:17.470419 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:17.472270 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:17.472278 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:17.472284 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:17.472520 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:17.472801 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:17.472803 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:17.472804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:17.472883 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:17.473304 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:17.473309 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:17.473416 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:00:17.473544 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 02:00:17.473680 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 02:00:17.473927 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.460574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:59477 (local address 127.14.175.194:44573)
0809 02:00:17.460973 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:17.460989 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:17.461014 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:00:17.461067 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:17.461073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:17.461305 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:17.461489 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:17.462162 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:17.462951 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:17.463812 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:17.464159 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:17.464244 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:17.470559 (+ 6315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:17.470569 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:17.470582 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:17.470605 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:17.472158 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:17.472624 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:17.472630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:17.472631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:17.472717 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:17.472961 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:17.472963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:17.472964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:17.473207 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:17.473331 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:17.473625 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 02:00:17.473748 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":101,"threads_started":1}
I20260809 02:00:17.474874 31400 tablet_copy_service.cc:140] P ee18bd5297b547c79a944d2fbcc3cc10: Received BeginTabletCopySession request for tablet 0df4133d0039431b8ff110cf1cb518a6 from peer 1d00d6bd8d35438a93e0822c58b1970c ({username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:59477)
I20260809 02:00:17.475070 31400 tablet_copy_service.cc:161] P ee18bd5297b547c79a944d2fbcc3cc10: Beginning new tablet copy session on tablet 0df4133d0039431b8ff110cf1cb518a6 from peer 1d00d6bd8d35438a93e0822c58b1970c at {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:59477: session id = 1d00d6bd8d35438a93e0822c58b1970c-0df4133d0039431b8ff110cf1cb518a6
I20260809 02:00:17.476161 31400 tablet_copy_source_session.cc:205] T 0df4133d0039431b8ff110cf1cb518a6 P ee18bd5297b547c79a944d2fbcc3cc10: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:00:17.479951 31593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4133d0039431b8ff110cf1cb518a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:17.486267 31593 tablet_copy_client.cc:791] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: tablet copy: Starting download of 0 data blocks...
I20260809 02:00:17.486482 31593 tablet_copy_client.cc:655] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: tablet copy: Starting download of 1 WAL segments...
I20260809 02:00:17.488233 31593 tablet_copy_client.cc:531] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:00:17.489764 31593 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Bootstrap starting.
I20260809 02:00:17.494942 31593 log.cc:824] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:17.501325 31593 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:17.501665 31593 tablet_bootstrap.cc:492] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Bootstrap complete.
I20260809 02:00:17.502023 31593 ts_tablet_manager.cc:1397] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260809 02:00:17.504274 31593 raft_consensus.cc:348] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:17.504546 31593 raft_consensus.cc:729] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d00d6bd8d35438a93e0822c58b1970c, State: Initialized, Role: FOLLOWER
I20260809 02:00:17.504964 31593 consensus_queue.cc:260] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee18bd5297b547c79a944d2fbcc3cc10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 44573 } } peers { permanent_uuid: "1d00d6bd8d35438a93e0822c58b1970c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 41081 } } peers { permanent_uuid: "a74eb668d6d34f1c8b0cbb0775af680d" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34843 } }
I20260809 02:00:17.505788 31593 ts_tablet_manager.cc:1428] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260809 02:00:17.506086 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.505833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:46073)
0809 02:00:17.505955 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.506022 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 02:00:17.506605 31400 tablet_copy_service.cc:342] P ee18bd5297b547c79a944d2fbcc3cc10: Request end of tablet copy session 1d00d6bd8d35438a93e0822c58b1970c-0df4133d0039431b8ff110cf1cb518a6 received from {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:59477
I20260809 02:00:17.506723 31400 tablet_copy_service.cc:433] P ee18bd5297b547c79a944d2fbcc3cc10: ending tablet copy session 1d00d6bd8d35438a93e0822c58b1970c-0df4133d0039431b8ff110cf1cb518a6 on tablet 0df4133d0039431b8ff110cf1cb518a6 with peer 1d00d6bd8d35438a93e0822c58b1970c
I20260809 02:00:17.506878 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.506587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:45107)
0809 02:00:17.506713 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.506772 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 02:00:17.997088 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.996687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:60317)
0809 02:00:17.996936 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.996989 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":92,"threads_started":1}
I20260809 02:00:17.997249 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:17.996856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:48109)
0809 02:00:17.997079 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:17.997130 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260809 02:00:18.011668 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:18.011408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:37725)
0809 02:00:18.011549 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:18.011595 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:00:18.011906 31521 raft_consensus.cc:1203] T 0df4133d0039431b8ff110cf1cb518a6 P 1d00d6bd8d35438a93e0822c58b1970c [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260809 02:00:18.012964 31603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:18.012645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:48063)
0809 02:00:18.012847 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:18.012894 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260809 02:00:18.998544 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:18.998072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:44327)
0809 02:00:18.998354 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:18.998439 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
I20260809 02:00:19.012723 31605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:19.012325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:55295)
0809 02:00:19.012573 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:19.012629 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":69,"threads_started":1}
I20260809 02:00:19.014150 31606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:19.013689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:36967)
0809 02:00:19.014017 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:19.014071 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":106,"threads_started":1}
I20260809 02:00:19.999981 31607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:19.999529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:50289)
0809 02:00:19.999824 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:19.999885 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":74,"threads_started":1}
I20260809 02:00:20.013995 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:20.013610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:55947)
0809 02:00:20.013845 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:20.013901 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":77,"threads_started":1}
I20260809 02:00:20.014734 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:20.014490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:41667)
0809 02:00:20.014603 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:20.014661 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 02:00:20.015317 31609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:20.014899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:38271)
0809 02:00:20.015193 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:20.015241 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":134,"threads_started":1}
I20260809 02:00:21.001109 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:21.000688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:57997)
0809 02:00:21.000962 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:21.001017 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":77,"threads_started":1}
I20260809 02:00:21.015831 31611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:21.015363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:56767)
0809 02:00:21.015626 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:21.015688 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":91,"threads_started":1}
I20260809 02:00:21.016521 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:21.016137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:57033)
0809 02:00:21.016381 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:21.016438 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":58,"threads_started":1}
I20260809 02:00:22.002346 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:22.001871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:46329)
0809 02:00:22.002175 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:22.002239 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":92,"threads_started":1}
I20260809 02:00:22.017032 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:22.016557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:54451)
0809 02:00:22.016834 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:22.016905 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260809 02:00:22.017609 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:22.017216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:34119)
0809 02:00:22.017483 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:22.017533 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":111,"threads_started":1}
I20260809 02:00:23.003773 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:23.003266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:33329)
0809 02:00:23.003550 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:23.003607 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":107,"threads_started":1}
I20260809 02:00:23.018257 31619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:23.017762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:51343)
0809 02:00:23.018048 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:23.018105 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":97,"threads_started":1}
I20260809 02:00:23.018766 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:23.018354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:32885)
0809 02:00:23.018638 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:23.018689 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":73,"threads_started":1}
I20260809 02:00:24.005081 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:24.004667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:54659)
0809 02:00:24.004930 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:24.004986 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":76,"threads_started":1}
I20260809 02:00:24.019665 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:24.019083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:44319)
0809 02:00:24.019462 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:24.019536 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":81,"threads_started":1}
I20260809 02:00:24.020169 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:24.019492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:48565)
0809 02:00:24.019966 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:24.020039 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":86,"threads_started":1}
I20260809 02:00:25.006717 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:25.006195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:43601)
0809 02:00:25.006510 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:25.006575 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":100,"threads_started":1}
I20260809 02:00:25.021044 31626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:25.020598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:51147)
0809 02:00:25.020892 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:25.020947 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":125,"threads_started":1}
I20260809 02:00:25.021433 31627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:25.020963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:33513)
0809 02:00:25.021255 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:25.021330 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":60,"threads_started":1}
I20260809 02:00:26.008147 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:26.007725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:57497)
0809 02:00:26.007983 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:26.008049 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
I20260809 02:00:26.022369 31630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:26.021828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:53881)
0809 02:00:26.022146 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:26.022207 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":71,"threads_started":1}
I20260809 02:00:26.022853 31631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:26.022346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:59955)
0809 02:00:26.022673 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:26.022726 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":54,"threads_started":1}
I20260809 02:00:27.009373 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:27.008935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:60419)
0809 02:00:27.009207 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:27.009267 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":75,"threads_started":1}
I20260809 02:00:27.023679 31633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:27.023214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:55221)
0809 02:00:27.023480 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:27.023545 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":66,"threads_started":1}
I20260809 02:00:27.024019 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:27.023541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:56507)
0809 02:00:27.023867 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:27.023936 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":96,"threads_started":1}
I20260809 02:00:28.010591 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:28.010129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:46707)
0809 02:00:28.010436 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:28.010495 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":100,"threads_started":1}
I20260809 02:00:28.024930 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:28.024436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:58653)
0809 02:00:28.024729 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:28.024798 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":82,"threads_started":1}
I20260809 02:00:28.025250 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:28.024771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:47575)
0809 02:00:28.025073 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:28.025140 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":100,"threads_started":1}
I20260809 02:00:29.011927 31639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:29.011486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:43177)
0809 02:00:29.011746 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:29.011804 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260809 02:00:29.026137 31640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:29.025672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:37053)
0809 02:00:29.025954 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:29.026017 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":68,"threads_started":1}
I20260809 02:00:29.026444 31641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:29.026003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:36555)
0809 02:00:29.026281 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:29.026361 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":75,"threads_started":1}
I20260809 02:00:30.013419 31643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:30.012904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.193:59559)
0809 02:00:30.013259 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:30.013322 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":72,"threads_started":1}
I20260809 02:00:30.027722 31645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:30.027243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.194:49099)
0809 02:00:30.027521 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:30.027574 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":83,"threads_started":1}
I20260809 02:00:30.027745 31644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:30.027244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:43493 (local address 127.14.175.195:43357)
0809 02:00:30.027573 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:30.027627 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":101,"threads_started":1}
I20260809 02:00:30.180763 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31103
I20260809 02:00:30.189213 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31287
I20260809 02:00:30.196772 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31430
2026-08-09T02:00:30Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19498 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:00:30 dist-test-slave-2w3w krb5kdc[31648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:00:30 dist-test-slave-2w3w krb5kdc[31648](info): set up 2 sockets
Aug 09 02:00:30 dist-test-slave-2w3w krb5kdc[31648](info): commencing operation
krb5kdc: starting...
W20260809 02:00:31.277383 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:00:31 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:00:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:00:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:00:31.401479 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:31.511911 31662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:31.512166 31662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:31.512210 31662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:31.516091 31662 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:00:31.516137 31662 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:00:31.516152 31662 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:00:31.516166 31662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:31.516184 31662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:31.516201 31662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:31.516219 31662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:31.516237 31662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:31.521320 31662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:31.522331 31662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:31.523314 31662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:31.531711 31667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:31.531723 31668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:31.531723 31670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:31.532284 31662 server_base.cc:1034] running on GCE node
I20260809 02:00:31.532822 31662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:31.533828 31662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:31.535037 31662 hybrid_clock.cc:648] HybridClock initialized: now 1786240831535019 us; error 29 us; skew 500 ppm
Aug 09 02:00:31 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240831, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:31.537729 31662 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:31.538542 31662 webserver.cc:460] Webserver started at http://127.14.175.254:33717/ using document root <none> and password file <none>
I20260809 02:00:31.539142 31662 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:31.539232 31662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:31.539453 31662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:31.541406 31662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "b43663055c154ec1b422610652736c87"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "6a2f08f5bb9404cdf6ca2869aa7c5ec8"
server_key_iv: "49a9cd1b5ce590bf0db26c57b0407021"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.541978 31662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "b43663055c154ec1b422610652736c87"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "6a2f08f5bb9404cdf6ca2869aa7c5ec8"
server_key_iv: "49a9cd1b5ce590bf0db26c57b0407021"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.545527 31662 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 02:00:31.547863 31677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:31.549015 31662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:00:31.549151 31662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "b43663055c154ec1b422610652736c87"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "6a2f08f5bb9404cdf6ca2869aa7c5ec8"
server_key_iv: "49a9cd1b5ce590bf0db26c57b0407021"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.549258 31662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:31.559655 31662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:31.562520 31662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:31.562716 31662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:31.569721 31662 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40249
I20260809 02:00:31.570001 31731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40249 every 8 connection(s)
I20260809 02:00:31.570735 31662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:31.573490 31732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:31.577932 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31662
I20260809 02:00:31.578097 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:00:31.578382 15039 external_mini_cluster.cc:1428] Setting key 400522df91be2ee7dce00243805674e2
I20260809 02:00:31.579253 31732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap starting.
I20260809 02:00:31.581930 31732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:31.582790 31732 log.cc:824] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:31.584803 31732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: No bootstrap required, opened a new log
Aug 09 02:00:31 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:31.588922 31732 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:31.589210 31732 raft_consensus.cc:374] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:31.589282 31732 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43663055c154ec1b422610652736c87, State: Initialized, Role: FOLLOWER
I20260809 02:00:31.589771 31732 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:31.589895 31732 raft_consensus.cc:388] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:31.589977 31732 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:31.590087 31732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:31.590932 31732 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:31.591312 31732 leader_election.cc:302] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b43663055c154ec1b422610652736c87; no voters:
I20260809 02:00:31.591657 31732 leader_election.cc:288] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:00:31.591740 31738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:31.591960 31738 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 LEADER]: Becoming Leader. State: Replica: b43663055c154ec1b422610652736c87, State: Running, Role: LEADER
I20260809 02:00:31.592303 31738 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:31.592895 31732 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:31.593856 31739 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:00:31.593997 31739 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:31.594179 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:31.579812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.14.175.254:40249)
0809 02:00:31.580242 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:31.580261 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:31.580316 (+ 55us) server_negotiation.cc:407] Connection header received
0809 02:00:31.581139 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:31.581161 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:31.581558 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:31.581911 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:31.582673 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.584061 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.584952 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.585626 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.585791 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:31.588545 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:31.588551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:31.588565 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:31.588594 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:31.590561 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:31.591025 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:31.591031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:31.591037 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:31.591186 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:31.591488 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:31.591491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:31.591493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:31.591995 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:31.592746 (+ 751us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:31.592862 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 02:00:31.593146 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":135,"threads_started":1}
I20260809 02:00:31.594383 31747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:31.593429 31738 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43663055c154ec1b422610652736c87. Latest consensus state: current_term: 1 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:00:31.595063 31738 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:31.597467 31747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:31.602454 31747 catalog_manager.cc:1347] Generated new cluster ID: 98080068a2e948d4b5cad893b99499e8
I20260809 02:00:31.602509 31747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:31.619969 31747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:00:31.621300 31747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:31.639124 31747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Generated new TSK 0
I20260809 02:00:31.639992 31747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:00:31.675889 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:31.787200 31759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:31.787449 31759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:31.787492 31759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:31.791450 31759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:31.791505 31759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:31.791599 31759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:31.797147 31759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:31.798133 31759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:31.799162 31759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:00:31.808769 31759 server_base.cc:1034] running on GCE node
W20260809 02:00:31.808728 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:31.808739 31765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:31.808732 31766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:31.809480 31759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:31.810071 31759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:31.811255 31759 hybrid_clock.cc:648] HybridClock initialized: now 1786240831811243 us; error 33 us; skew 500 ppm
Aug 09 02:00:31 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240831, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:31.813944 31759 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:31.814813 31759 webserver.cc:460] Webserver started at http://127.14.175.193:43193/ using document root <none> and password file <none>
I20260809 02:00:31.815397 31759 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:31.815459 31759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:31.815701 31759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:31.817663 31759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "efd4fffb783f4475b7857d561494477b"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "4298364b310991212b209992d847ab98"
server_key_iv: "a50dc64b7a47e1a17a0487aaae186038"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.818208 31759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "efd4fffb783f4475b7857d561494477b"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "4298364b310991212b209992d847ab98"
server_key_iv: "a50dc64b7a47e1a17a0487aaae186038"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.821811 31759 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:00:31.824244 31778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:31.825475 31759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:00:31.825587 31759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "efd4fffb783f4475b7857d561494477b"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "4298364b310991212b209992d847ab98"
server_key_iv: "a50dc64b7a47e1a17a0487aaae186038"
server_key_version: "encryptionkey@0"
I20260809 02:00:31.825695 31759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:31.846843 31759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:31.849560 31759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:31.849752 31759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:31.850325 31759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:31.851157 31759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:31.851204 31759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:31.851267 31759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:31.851297 31759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:31.860412 31759 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:36019
I20260809 02:00:31.860438 31894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:36019 every 8 connection(s)
I20260809 02:00:31.861371 31759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:31.863102 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31759
I20260809 02:00:31.863237 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:00:31.863569 15039 external_mini_cluster.cc:1428] Setting key 68b21c611b23bb0b010ab3b8f26d81b2
Aug 09 02:00:31 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240831, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 02:00:31.877534 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:31.863211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:52205 (local address 127.14.175.254:40249)
0809 02:00:31.863342 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:31.863346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:31.864857 (+ 1511us) server_negotiation.cc:407] Connection header received
0809 02:00:31.866051 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:31.866053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:31.866096 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:31.866157 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:31.867770 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.868312 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.870100 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.870379 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.870499 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:31.873581 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:31.873584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:31.873586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:31.873610 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:31.875247 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:31.875789 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:31.875795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:31.875797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:31.875885 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:31.876247 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:31.876250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:31.876252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:31.876448 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:31.876557 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:31.877169 (+ 612us) server_negotiation.cc:299] Negotiation successful
0809 02:00:31.877351 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:00:31.878563 31898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:31.863705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:52205)
0809 02:00:31.864674 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:31.864731 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:31.865816 (+ 1085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:31.866334 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:31.866346 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:31.866882 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:31.867613 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:31.867629 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.868448 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.868454 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:31.869959 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:31.869975 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:31.870580 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:31.870588 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:31.870817 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:31.871475 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:31.871512 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:31.873384 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:31.875372 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:31.875378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:31.875394 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:31.875665 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:31.875983 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:31.875987 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:31.875989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:31.876140 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:31.876559 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:31.876566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:31.876915 (+ 349us) client_negotiation.cc:769] Sending connection context
0809 02:00:31.877115 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 02:00:31.877480 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":596,"threads_started":1}
I20260809 02:00:31.879947 31895 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:31.880250 31895 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:31.880877 31895 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:31.882427 31695 ts_manager.cc:194] Registered new tserver with Master: efd4fffb783f4475b7857d561494477b (127.14.175.193:36019)
I20260809 02:00:31.883677 31695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:52205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 02:00:31.895925 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:32.005246 31901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:32.005519 31901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:32.005630 31901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:32.009655 31901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:32.009758 31901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:32.009850 31901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:32.015218 31901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:32.016286 31901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:32.017323 31901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:32.026737 31909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:32.026834 31907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:32.026775 31906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:32.027010 31901 server_base.cc:1034] running on GCE node
I20260809 02:00:32.027480 31901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:32.028113 31901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:32.029273 31901 hybrid_clock.cc:648] HybridClock initialized: now 1786240832029244 us; error 42 us; skew 500 ppm
Aug 09 02:00:32 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240832, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:32.032060 31901 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:32.033015 31901 webserver.cc:460] Webserver started at http://127.14.175.194:35397/ using document root <none> and password file <none>
I20260809 02:00:32.033588 31901 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:32.033650 31901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:32.033902 31901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:32.036073 31901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "78b3c1d504b5498f87360040865e8b84"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "bd86f0e2b943326bf50c4aaf10637fde"
server_key_iv: "0b8ede36c6d1cae223c5a7e3b7866cfe"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.036667 31901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "78b3c1d504b5498f87360040865e8b84"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "bd86f0e2b943326bf50c4aaf10637fde"
server_key_iv: "0b8ede36c6d1cae223c5a7e3b7866cfe"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.040341 31901 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260809 02:00:32.042691 31917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.043980 31901 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:32.044104 31901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "78b3c1d504b5498f87360040865e8b84"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "bd86f0e2b943326bf50c4aaf10637fde"
server_key_iv: "0b8ede36c6d1cae223c5a7e3b7866cfe"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.044219 31901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:32.058264 31901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:32.061360 31901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:32.061565 31901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:32.062135 31901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:32.062951 31901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:32.063112 31901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.063179 31901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:32.063226 31901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.072055 31901 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38593
I20260809 02:00:32.072099 32041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38593 every 8 connection(s)
I20260809 02:00:32.072932 31901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:00:32 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240832, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:32.082615 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 31901
I20260809 02:00:32.082763 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:00:32.083132 15039 external_mini_cluster.cc:1428] Setting key 97acdac893691841df2660853a4955f4
I20260809 02:00:32.086675 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.074670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:57435 (local address 127.14.175.254:40249)
0809 02:00:32.074812 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.074816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.075629 (+ 813us) server_negotiation.cc:407] Connection header received
0809 02:00:32.076927 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.076931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.076992 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.077102 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:32.078236 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.078776 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.079974 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.080218 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.080329 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.082713 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:32.082717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:32.082722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:32.082752 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:32.084505 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.085007 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.085013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.085016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.085124 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.085471 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.085477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.085481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.085729 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:32.085836 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.086280 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.086428 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:00:32.087416 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.075028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:57435)
0809 02:00:32.075475 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.075520 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.076720 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.077285 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.077292 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.077633 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:32.078089 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.078102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.078905 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.078908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.079842 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.079851 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.080369 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.080373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.080571 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.081119 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:32.081134 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:32.082548 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:32.084615 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:32.084622 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:32.084635 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:32.084903 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:32.085234 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:32.085236 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:32.085237 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:32.085361 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:32.085831 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:32.085835 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:32.086047 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.086195 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.086429 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260809 02:00:32.088532 32042 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:32.088774 32042 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:32.089236 32042 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:32.090258 31695 ts_manager.cc:194] Registered new tserver with Master: 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:32.091145 31695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:57435
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:00:32.112015 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:32.220106 32047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:32.220340 32047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:32.220379 32047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:32.224424 32047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:32.224478 32047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:32.224532 32047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:32.229585 32047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:32.230486 32047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:32.231412 32047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:32.240294 32052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:32.240303 32053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:32.240371 32047 server_base.cc:1034] running on GCE node
W20260809 02:00:32.240613 32055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:32.240999 32047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:32.241598 32047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:32.242781 32047 hybrid_clock.cc:648] HybridClock initialized: now 1786240832242752 us; error 41 us; skew 500 ppm
Aug 09 02:00:32 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240832, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:32.245510 32047 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:32.246338 32047 webserver.cc:460] Webserver started at http://127.14.175.195:45001/ using document root <none> and password file <none>
I20260809 02:00:32.246861 32047 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:32.246951 32047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:32.247200 32047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:00:32.249099 32047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "f31b41aabbb0a6b59949216f2d60b63f"
server_key_iv: "42dbf264b446444633301246fc5a5091"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.249665 32047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "f31b41aabbb0a6b59949216f2d60b63f"
server_key_iv: "42dbf264b446444633301246fc5a5091"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.253180 32047 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:00:32.255452 32064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.256557 32047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:00:32.256690 32047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "f31b41aabbb0a6b59949216f2d60b63f"
server_key_iv: "42dbf264b446444633301246fc5a5091"
server_key_version: "encryptionkey@0"
I20260809 02:00:32.256827 32047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:32.272480 32047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:32.275569 32047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:32.275768 32047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:32.276324 32047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:32.277094 32047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:32.277163 32047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.277232 32047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:32.277276 32047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:32.285903 32047 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:33461
I20260809 02:00:32.285929 32186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:33461 every 8 connection(s)
I20260809 02:00:32.286703 32047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:00:32.288091 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 32047
I20260809 02:00:32.288244 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:00:32.288610 15039 external_mini_cluster.cc:1428] Setting key d9316b80919a8c9fb3630b45074a9c15
Aug 09 02:00:32 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240832, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:32.300271 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.288657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:50217 (local address 127.14.175.254:40249)
0809 02:00:32.288811 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.288816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.289661 (+ 845us) server_negotiation.cc:407] Connection header received
0809 02:00:32.291161 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.291165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.291220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.291300 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:32.292386 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.292929 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.294231 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.294474 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.294590 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.296979 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:32.296983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:32.296985 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:32.297015 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:32.298211 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.298719 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.298723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.298724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.298811 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.299208 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.299213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.299215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.299399 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:32.299516 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.299975 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.300102 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:00:32.300971 32189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.289053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:50217)
0809 02:00:32.289525 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.289585 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.290907 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.291464 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.291471 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.291798 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:32.292243 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.292256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.293081 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.293084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.294100 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.294111 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.294637 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.294641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.294833 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.295418 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:32.295434 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:32.296820 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:32.298331 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:32.298336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:32.298349 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:32.298609 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:32.298904 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:32.298908 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:32.298910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:32.299109 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:32.299508 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:32.299515 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:32.299743 (+ 228us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.299916 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.300226 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":105,"threads_started":1}
I20260809 02:00:32.302124 32187 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:32.302402 32187 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:32.303014 32187 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:32.303987 31694 ts_manager.cc:194] Registered new tserver with Master: 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461)
I20260809 02:00:32.304550 31694 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:50217
I20260809 02:00:32.314347 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:32.323478 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.316282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.14.175.254:40249)
0809 02:00:32.316425 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.316430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.316633 (+ 203us) server_negotiation.cc:407] Connection header received
0809 02:00:32.316784 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.316787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.316830 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.316915 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:32.317602 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.318101 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.318922 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.319192 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.319302 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.320552 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:32.320555 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:32.320558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:32.320581 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:32.321778 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.322201 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.322206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.322207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.322293 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:32.322570 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:32.322573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:32.322575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:32.322785 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:32.322930 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.323200 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.323316 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:00:32.326079 31694 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:00:32.329174 31694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:00:32.343008 32202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.337172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56710 (local address 127.14.175.195:33461)
0809 02:00:32.338190 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.338202 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.338224 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:00:32.338295 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.338300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.338487 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.338665 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.339065 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.339996 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.341606 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.342345 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342480 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.342606 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.342753 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.342849 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":914,"thread_start_us":154,"threads_started":1}
I20260809 02:00:32.343001 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.337032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33461 (local address 127.0.0.1:56710)
0809 02:00:32.337776 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.337831 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.337957 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.338660 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.338668 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.338693 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.338932 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.338941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.340133 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.340137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.341455 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.341465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.342469 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.342577 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.342613 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.342714 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.342833 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":31,"spinlock_wait_cycles":7424,"thread_start_us":74,"threads_started":1}
I20260809 02:00:32.343240 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.337519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.14.175.194:38593)
0809 02:00:32.337955 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.337967 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.337990 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:00:32.338153 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.338159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.338384 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.338535 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.339127 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.340319 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.341689 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.342379 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342495 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.342620 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.342988 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.343090 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":140,"threads_started":1}
I20260809 02:00:32.343596 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.337717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:36019 (local address 127.0.0.1:34476)
0809 02:00:32.338641 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.338655 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.338736 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.339433 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.339436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.339455 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.339543 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.339552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.340872 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.340875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.341944 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.341955 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.343183 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.343186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.343282 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.343307 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.343393 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.343463 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"thread_start_us":86,"threads_started":1}
I20260809 02:00:32.343686 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.338226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34476 (local address 127.14.175.193:36019)
0809 02:00:32.338974 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.338992 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.339016 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:00:32.339091 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.339098 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.339272 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.339436 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.339664 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.340730 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342078 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.342862 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342999 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.343118 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.343431 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.343537 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":119,"threads_started":1}
I20260809 02:00:32.343662 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.337113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.0.0.1:60846)
0809 02:00:32.337776 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.337831 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.337957 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.338696 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.338698 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.338710 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.338939 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.338946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.340460 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.340464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.341564 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.341572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.342690 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.342694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.342788 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.342812 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.343469 (+ 657us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.343537 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":91,"spinlock_wait_cycles":13440,"thread_start_us":104,"threads_started":1}
I20260809 02:00:32.346200 31828 tablet_service.cc:1467] Processing CreateTablet for tablet baf5ea265a6549eb98255accff769eed (DEFAULT_TABLE table=test-table [id=f6e9ca93ad6242a6b392c79fff272759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:32.346272 32115 tablet_service.cc:1467] Processing CreateTablet for tablet baf5ea265a6549eb98255accff769eed (DEFAULT_TABLE table=test-table [id=f6e9ca93ad6242a6b392c79fff272759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:32.346298 31970 tablet_service.cc:1467] Processing CreateTablet for tablet baf5ea265a6549eb98255accff769eed (DEFAULT_TABLE table=test-table [id=f6e9ca93ad6242a6b392c79fff272759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:32.347227 31828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf5ea265a6549eb98255accff769eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:32.347281 31970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf5ea265a6549eb98255accff769eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:32.347285 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf5ea265a6549eb98255accff769eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:32.353448 32206 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Bootstrap starting.
I20260809 02:00:32.354578 32207 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Bootstrap starting.
I20260809 02:00:32.354732 32208 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Bootstrap starting.
I20260809 02:00:32.355670 32206 tablet_bootstrap.cc:654] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:32.356710 32206 log.cc:824] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:32.357188 32208 tablet_bootstrap.cc:654] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:32.357188 32207 tablet_bootstrap.cc:654] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:32.358007 32208 log.cc:824] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:32.358007 32207 log.cc:824] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:32.359179 32206 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: No bootstrap required, opened a new log
I20260809 02:00:32.359371 32206 ts_tablet_manager.cc:1397] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:00:32.359762 32207 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: No bootstrap required, opened a new log
I20260809 02:00:32.359958 32208 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: No bootstrap required, opened a new log
I20260809 02:00:32.359992 32207 ts_tablet_manager.cc:1397] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:00:32.360159 32208 ts_tablet_manager.cc:1397] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:00:32.363114 32207 raft_consensus.cc:348] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.363359 32207 raft_consensus.cc:374] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:32.363242 32206 raft_consensus.cc:348] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.363433 32207 raft_consensus.cc:729] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b3c1d504b5498f87360040865e8b84, State: Initialized, Role: FOLLOWER
I20260809 02:00:32.363494 32206 raft_consensus.cc:374] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:32.363600 32206 raft_consensus.cc:729] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4fffb783f4475b7857d561494477b, State: Initialized, Role: FOLLOWER
I20260809 02:00:32.364002 32207 consensus_queue.cc:260] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.364032 32206 consensus_queue.cc:260] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.364123 32208 raft_consensus.cc:348] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.364418 32208 raft_consensus.cc:374] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:32.364519 32208 raft_consensus.cc:729] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de8b925d9bb42db80a3d5a880c2d8b5, State: Initialized, Role: FOLLOWER
I20260809 02:00:32.364670 32042 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
I20260809 02:00:32.364995 32207 ts_tablet_manager.cc:1428] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:00:32.365199 32208 consensus_queue.cc:260] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.365473 32206 ts_tablet_manager.cc:1428] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:00:32.365772 31895 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
I20260809 02:00:32.365844 32187 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
I20260809 02:00:32.366087 32208 ts_tablet_manager.cc:1428] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:00:32.402385 32213 raft_consensus.cc:482] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:32.402583 32213 raft_consensus.cc:504] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.403707 32213 leader_election.cc:288] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:32.405568 32214 raft_consensus.cc:482] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:32.405750 32214 raft_consensus.cc:504] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.407126 32214 leader_election.cc:288] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593), efd4fffb783f4475b7857d561494477b (127.14.175.193:36019)
I20260809 02:00:32.408335 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.404142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:40017 (local address 127.14.175.194:38593)
0809 02:00:32.404284 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.404289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.404466 (+ 177us) server_negotiation.cc:407] Connection header received
0809 02:00:32.404641 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.404644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.404698 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.404787 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.405072 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.405782 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.406925 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.407594 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.407722 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.407791 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.408116 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.408209 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:00:32.408367 32216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.404021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.14.175.193:40017)
0809 02:00:32.404366 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.404378 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.404519 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.404795 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.404798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.404815 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.404949 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.404954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.405905 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.405911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.406790 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.406799 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.407903 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.407907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.408004 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.408030 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.408105 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.408177 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260809 02:00:32.408963 32202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.404159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:49969 (local address 127.14.175.195:33461)
0809 02:00:32.404365 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.404370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.404533 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:00:32.404687 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.404690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.404731 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.404862 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.405129 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.405872 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.407430 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.408014 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.408116 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.408158 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.408756 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.408844 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 02:00:32.409011 31994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b3c1d504b5498f87360040865e8b84" is_pre_election: true
I20260809 02:00:32.409287 31994 raft_consensus.cc:2454] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 0.
I20260809 02:00:32.409546 32215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.404021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33461 (local address 127.14.175.193:49969)
0809 02:00:32.404433 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.404446 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.404565 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.404876 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.404879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.404895 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.405018 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.405023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.405985 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.405988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.407258 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.407269 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.408244 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.408248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.408356 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.408389 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.409307 (+ 918us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.409382 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":37,"thread_start_us":91,"threads_started":1}
I20260809 02:00:32.409861 31782 leader_election.cc:302] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b3c1d504b5498f87360040865e8b84, efd4fffb783f4475b7857d561494477b; no voters:
I20260809 02:00:32.410043 32136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" is_pre_election: true
I20260809 02:00:32.410219 32136 raft_consensus.cc:2454] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 0.
I20260809 02:00:32.410724 32213 raft_consensus.cc:2781] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:32.410830 32213 raft_consensus.cc:482] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:32.411139 32213 raft_consensus.cc:3037] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:32.412192 32189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.407302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.14.175.195:53073)
0809 02:00:32.407857 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.407872 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.407951 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.408241 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.408243 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.408259 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.408380 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.408389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.409455 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.409458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.410803 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.410816 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.411816 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.411820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.411933 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.411960 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.412010 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.412075 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":27}
I20260809 02:00:32.412817 32217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.407449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:53073 (local address 127.14.175.194:38593)
0809 02:00:32.407816 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.407824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.408032 (+ 208us) server_negotiation.cc:407] Connection header received
0809 02:00:32.408078 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.408083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.408131 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.408493 (+ 362us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.408604 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.409316 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.411020 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.411677 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.412488 (+ 811us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.412545 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.412584 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.412667 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":114,"threads_started":1}
I20260809 02:00:32.412760 32213 raft_consensus.cc:504] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.412882 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.407959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33171 (local address 127.14.175.193:36019)
0809 02:00:32.408067 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.408071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.408839 (+ 768us) server_negotiation.cc:407] Connection header received
0809 02:00:32.409002 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.409006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.409051 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.409107 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:32.409475 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.410216 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.411744 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.412225 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.412371 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.412413 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.412713 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.412776 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:00:32.412914 32218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.407543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:36019 (local address 127.14.175.195:33171)
0809 02:00:32.408753 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.408767 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:32.408897 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:32.409225 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:32.409229 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:32.409249 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:32.409357 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.409363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.410437 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.410440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.411599 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:32.411609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.412511 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.412514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:32.412596 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.412611 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:00:32.412697 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:00:32.412763 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":3,"thread_start_us":123,"threads_started":1}
I20260809 02:00:32.413123 32213 leader_election.cc:288] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 election: Requested vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:32.413470 31848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd4fffb783f4475b7857d561494477b" is_pre_election: true
I20260809 02:00:32.413538 31993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b3c1d504b5498f87360040865e8b84"
I20260809 02:00:32.413712 31848 raft_consensus.cc:2379] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2de8b925d9bb42db80a3d5a880c2d8b5 in current term 1: Already voted for candidate efd4fffb783f4475b7857d561494477b in this term.
I20260809 02:00:32.413699 31993 raft_consensus.cc:3037] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:32.414281 32136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
I20260809 02:00:32.414412 32136 raft_consensus.cc:3037] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:32.414485 31994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf5ea265a6549eb98255accff769eed" candidate_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b3c1d504b5498f87360040865e8b84" is_pre_election: true
I20260809 02:00:32.414952 31993 raft_consensus.cc:2454] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 1.
I20260809 02:00:32.415107 32068 leader_election.cc:302] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2de8b925d9bb42db80a3d5a880c2d8b5; no voters: 78b3c1d504b5498f87360040865e8b84, efd4fffb783f4475b7857d561494477b
I20260809 02:00:32.415235 31782 leader_election.cc:302] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b3c1d504b5498f87360040865e8b84, efd4fffb783f4475b7857d561494477b; no voters:
I20260809 02:00:32.415418 32213 raft_consensus.cc:2781] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:32.415622 32213 raft_consensus.cc:686] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 LEADER]: Becoming Leader. State: Replica: efd4fffb783f4475b7857d561494477b, State: Running, Role: LEADER
I20260809 02:00:32.415889 32136 raft_consensus.cc:2454] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 1.
I20260809 02:00:32.415967 32213 consensus_queue.cc:237] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:32.416024 32214 raft_consensus.cc:2726] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 02:00:32.419216 31694 catalog_manager.cc:5495] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b reported cstate change: term changed from 0 to 1, leader changed from <none> to efd4fffb783f4475b7857d561494477b (127.14.175.193). New cstate: current_term: 1 leader_uuid: "efd4fffb783f4475b7857d561494477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } health_report { overall_health: HEALTHY } } }
I20260809 02:00:32.439445 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.435691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34484 (local address 127.14.175.193:36019)
0809 02:00:32.435823 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:32.435828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:32.435849 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:00:32.435945 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:32.435948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:32.436000 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:32.436079 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:32.436360 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.437093 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.438050 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:32.438255 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:32.438335 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:32.438643 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:32.439091 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:32.439199 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:32.439296 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:00:32.439340 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:00:32.444984 32136 raft_consensus.cc:1261] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Refusing update from remote peer efd4fffb783f4475b7857d561494477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:32.445025 31993 raft_consensus.cc:1261] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Refusing update from remote peer efd4fffb783f4475b7857d561494477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:32.445611 32213 consensus_queue.cc:1035] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:32.445835 32219 consensus_queue.cc:1035] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:32.454430 32224 mvcc.cc:205] Tried to move back new op lower bound from 7316442449688285184 to 7316442449578733568. Current Snapshot: MvccSnapshot[applied={T|T < 7316442449688285184}]
I20260809 02:00:32.463255 31694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:32.463420 31694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:32.465834 31694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Sending DeleteTablet for 3 replicas of tablet baf5ea265a6549eb98255accff769eed
I20260809 02:00:32.466606 32115 tablet_service.cc:1514] Processing DeleteTablet for tablet baf5ea265a6549eb98255accff769eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:32 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:56710
I20260809 02:00:32.466691 31828 tablet_service.cc:1514] Processing DeleteTablet for tablet baf5ea265a6549eb98255accff769eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:32 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:34476
I20260809 02:00:32.466893 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31759
I20260809 02:00:32.467116 31970 tablet_service.cc:1514] Processing DeleteTablet for tablet baf5ea265a6549eb98255accff769eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:32 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:60846
I20260809 02:00:32.468492 32233 tablet_replica.cc:330] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: stopping tablet replica
I20260809 02:00:32.468842 32233 raft_consensus.cc:2229] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:32.469141 32233 raft_consensus.cc:2258] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:32.470383 32234 tablet_replica.cc:330] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: stopping tablet replica
I20260809 02:00:32.470660 32234 raft_consensus.cc:2229] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:32.470738 32233 ts_tablet_manager.cc:1905] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:32.471019 32234 raft_consensus.cc:2258] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:32.472179 32234 ts_tablet_manager.cc:1905] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:32.474466 32234 ts_tablet_manager.cc:1918] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:32.474581 32234 log.cc:1196] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/baf5ea265a6549eb98255accff769eed
I20260809 02:00:32.474802 32233 ts_tablet_manager.cc:1918] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:32.474921 32233 log.cc:1196] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/baf5ea265a6549eb98255accff769eed
I20260809 02:00:32.474943 32234 ts_tablet_manager.cc:1939] T baf5ea265a6549eb98255accff769eed P 78b3c1d504b5498f87360040865e8b84: Deleting consensus metadata
I20260809 02:00:32.475320 32233 ts_tablet_manager.cc:1939] T baf5ea265a6549eb98255accff769eed P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting consensus metadata
I20260809 02:00:32.476109 31681 catalog_manager.cc:4841] TS 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): tablet baf5ea265a6549eb98255accff769eed (table test-table [id=f6e9ca93ad6242a6b392c79fff272759]) successfully deleted
I20260809 02:00:32.476485 31680 catalog_manager.cc:4841] TS 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): tablet baf5ea265a6549eb98255accff769eed (table test-table [id=f6e9ca93ad6242a6b392c79fff272759]) successfully deleted
W20260809 02:00:32.476972 31681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:36019 (error 108)
I20260809 02:00:32.477762 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31901
I20260809 02:00:32.477974 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:32.477690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:36019 (local address 127.0.0.1:34486)
0809 02:00:32.477812 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:32.477881 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:00:32.479175 31681 catalog_manager.cc:4584] TS efd4fffb783f4475b7857d561494477b (127.14.175.193:36019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet baf5ea265a6549eb98255accff769eed: Network error: Client connection negotiation failed: client connection to 127.14.175.193:36019: connect: Connection refused (error 111)
I20260809 02:00:32.486266 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 32047
I20260809 02:00:32.495796 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 31662
I20260809 02:00:52.503922 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--webserver_interface=127.14.175.254
--webserver_port=33717
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:00:52.613917 32236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:52.614205 32236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:52.614319 32236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:52.618585 32236 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:00:52.618638 32236 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:00:52.618654 32236 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:00:52.618669 32236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:00:52.618685 32236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:52.618703 32236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:52.618719 32236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:00:52.618741 32236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:00:52.624269 32236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=33717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:52.625218 32236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:52.626196 32236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:52.639901 32245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:52.639963 32242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:52.639966 32236 server_base.cc:1034] running on GCE node
W20260809 02:00:52.640158 32243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:52.640744 32236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:52.641801 32236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:52.643006 32236 hybrid_clock.cc:648] HybridClock initialized: now 1786240852642989 us; error 27 us; skew 500 ppm
Aug 09 02:00:52 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240852, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:52.645639 32236 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:00:52.646533 32236 webserver.cc:460] Webserver started at http://127.14.175.254:33717/ using document root <none> and password file <none>
I20260809 02:00:52.647161 32236 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:52.647264 32236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:52.651093 32236 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260809 02:00:52.653106 32253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:52.654313 32236 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:52.654452 32236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "b43663055c154ec1b422610652736c87"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "6a2f08f5bb9404cdf6ca2869aa7c5ec8"
server_key_iv: "49a9cd1b5ce590bf0db26c57b0407021"
server_key_version: "encryptionkey@0"
I20260809 02:00:52.655120 32236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:52.689343 32236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:52.692277 32236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:52.692480 32236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:52.699631 32236 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40249
I20260809 02:00:52.699937 32310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40249 every 8 connection(s)
I20260809 02:00:52.700702 32236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:00:52.701372 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 32236
I20260809 02:00:52.701803 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:36019
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=43193
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:52.705196 32311 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:00:52.706840 32311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap starting.
I20260809 02:00:52.724776 32311 log.cc:824] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:52.733269 32311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:52.733656 32311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap complete.
I20260809 02:00:52.737713 32311 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:52.738116 32311 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43663055c154ec1b422610652736c87, State: Initialized, Role: FOLLOWER
I20260809 02:00:52.738617 32311 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:52.738760 32311 raft_consensus.cc:388] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:00:52.738853 32311 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:00:52.739012 32311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:00:52.740849 32311 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:52.741206 32311 leader_election.cc:302] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b43663055c154ec1b422610652736c87; no voters:
I20260809 02:00:52.741546 32311 leader_election.cc:288] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:00:52.741696 32315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:00:52.741946 32315 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 LEADER]: Becoming Leader. State: Replica: b43663055c154ec1b422610652736c87, State: Running, Role: LEADER
I20260809 02:00:52.742296 32315 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:00:52.742743 32311 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:00:52.743685 32316 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:00:52.743800 32316 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:52.744529 32324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:00:52.744612 32317 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43663055c154ec1b422610652736c87. Latest consensus state: current_term: 2 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:00:52.744753 32317 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:00:52.749104 32324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:00:52.749712 32324 catalog_manager.cc:1259] Loaded cluster ID: 98080068a2e948d4b5cad893b99499e8
I20260809 02:00:52.749776 32324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:00:52.752241 32324 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:00:52.752933 32324 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Loaded TSK: 0
I20260809 02:00:52.771678 32324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Generated new TSK 1
I20260809 02:00:52.771929 32324 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:00:52.814203 32313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:52.814476 32313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:52.814558 32313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:52.818856 32313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:52.818975 32313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:52.819082 32313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:00:52.824219 32313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:36019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=43193
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:52.825242 32313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:52.826249 32313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:52.836650 32340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:52.836804 32313 server_base.cc:1034] running on GCE node
W20260809 02:00:52.836737 32342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:52.836650 32339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:52.837451 32313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:52.838168 32313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:52.839355 32313 hybrid_clock.cc:648] HybridClock initialized: now 1786240852839330 us; error 35 us; skew 500 ppm
Aug 09 02:00:52 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240852, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:52.842636 32313 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:00:52.843693 32313 webserver.cc:460] Webserver started at http://127.14.175.193:43193/ using document root <none> and password file <none>
I20260809 02:00:52.844342 32313 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:52.844449 32313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:52.848248 32313 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 02:00:52.850407 32349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:52.851651 32313 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:52.851780 32313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "efd4fffb783f4475b7857d561494477b"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "4298364b310991212b209992d847ab98"
server_key_iv: "a50dc64b7a47e1a17a0487aaae186038"
server_key_version: "encryptionkey@0"
I20260809 02:00:52.852295 32313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:52.863166 32313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:52.866073 32313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:52.866266 32313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:52.866807 32313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:52.867966 32356 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:00:52.871848 32313 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:00:52.871908 32313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260809 02:00:52.871951 32313 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:00:52.873524 32313 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:00:52.873580 32313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:00:52.873816 32356 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Bootstrap starting.
I20260809 02:00:52.884702 32313 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:36019
I20260809 02:00:52.884965 32470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:36019 every 8 connection(s)
I20260809 02:00:52.885876 32313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:00:52.888811 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 32313
I20260809 02:00:52.889314 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:38593
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=35397
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:00:52.896342 32356 log.cc:824] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:00:52 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240852, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:52.908146 32356 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:00:52.908565 32356 tablet_bootstrap.cc:492] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Bootstrap complete.
I20260809 02:00:52.909950 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:52.888082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:41801 (local address 127.14.175.254:40249)
0809 02:00:52.888479 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:52.888497 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:52.891797 (+ 3300us) server_negotiation.cc:407] Connection header received
0809 02:00:52.894486 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:52.894502 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:52.894915 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:52.895354 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:52.897211 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.898666 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.900351 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.900991 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.901113 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:52.904287 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:52.904293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:52.904307 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:52.904336 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:52.906466 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:52.907088 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:52.907093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:52.907098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:52.907231 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:52.907598 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:52.907601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:52.907603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:52.907983 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:52.908104 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:52.908772 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 02:00:52.909077 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
I20260809 02:00:52.910133 32356 ts_tablet_manager.cc:1397] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Time spent bootstrapping tablet: real 0.037s user 0.026s sys 0.004s
I20260809 02:00:52.911187 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:52.888091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:41801)
0809 02:00:52.891581 (+ 3490us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:52.891645 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:52.893967 (+ 2322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:52.895950 (+ 1983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:52.895960 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:52.896451 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:52.897028 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:52.897045 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.898849 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.898852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:52.900215 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:52.900226 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.901319 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.901322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:52.901496 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:52.902207 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:52.902226 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:52.904088 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:52.906608 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:52.906613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:52.906624 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:52.906922 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:52.907340 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:52.907342 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:52.907344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:52.907494 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:52.908173 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:52.908178 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:52.908436 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 02:00:52.910229 (+ 1793us) client_negotiation.cc:240] Negotiation successful
0809 02:00:52.910514 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3237,"thread_start_us":140,"threads_started":1}
I20260809 02:00:52.912964 32356 raft_consensus.cc:348] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:52.913378 32471 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:52.913453 32356 raft_consensus.cc:729] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4fffb783f4475b7857d561494477b, State: Initialized, Role: FOLLOWER
I20260809 02:00:52.913614 32471 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:52.913918 32356 consensus_queue.cc:260] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:52.914119 32471 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:52.914901 32356 ts_tablet_manager.cc:1428] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 02:00:52.916535 32271 ts_manager.cc:194] Registered new tserver with Master: efd4fffb783f4475b7857d561494477b (127.14.175.193:36019)
I20260809 02:00:52.919878 32271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:41801
I20260809 02:00:52.922489 32471 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
Aug 09 02:00:52 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240852, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.193@KRBTEST.COM
I20260809 02:00:52.929672 32478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:52.919225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:36019 (local address 127.0.0.1:59968)
0809 02:00:52.919949 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:52.919994 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:52.920183 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:52.920696 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:52.920703 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:52.921095 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:52.921266 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:52.921273 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.922215 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.922220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:52.923067 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:52.923080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.923805 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.923811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:52.923934 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:52.924556 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:52.924570 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:52.926134 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:52.928111 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:52.928119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:52.928122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:52.928329 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:52.928634 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:52.928636 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:52.928637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:52.928708 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:52.929205 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:52.929210 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:52.929308 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:00:52.929419 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 02:00:52.929554 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":106,"threads_started":1}
I20260809 02:00:52.929828 32479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:52.919320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59968 (local address 127.14.175.193:36019)
0809 02:00:52.919683 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:52.919692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:52.920082 (+ 390us) server_negotiation.cc:407] Connection header received
0809 02:00:52.920352 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:52.920358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:52.920552 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:52.920701 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:52.921384 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.922085 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.923202 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:52.923675 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:52.923783 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:52.926270 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:52.926280 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:52.926290 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:52.926315 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:52.928007 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:52.928450 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:52.928455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:52.928457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:52.928544 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:52.928793 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:52.928796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:52.928798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:52.929082 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:52.929208 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:52.929523 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 02:00:52.929679 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":108,"threads_started":1}
I20260809 02:00:52.930692 32400 tablet_service.cc:1514] Processing DeleteTablet for tablet baf5ea265a6549eb98255accff769eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:32 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:59968
I20260809 02:00:52.931551 32480 tablet_replica.cc:330] stopping tablet replica
I20260809 02:00:52.931838 32480 raft_consensus.cc:2229] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:52.932070 32480 raft_consensus.cc:2258] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:52.932961 32480 ts_tablet_manager.cc:1905] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:52.936352 32480 ts_tablet_manager.cc:1918] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:52.936463 32480 log.cc:1196] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal/wals/baf5ea265a6549eb98255accff769eed
I20260809 02:00:52.936739 32480 ts_tablet_manager.cc:1939] T baf5ea265a6549eb98255accff769eed P efd4fffb783f4475b7857d561494477b: Deleting consensus metadata
I20260809 02:00:52.938228 32257 catalog_manager.cc:4841] TS efd4fffb783f4475b7857d561494477b (127.14.175.193:36019): tablet baf5ea265a6549eb98255accff769eed (table test-table [id=f6e9ca93ad6242a6b392c79fff272759]) successfully deleted
W20260809 02:00:53.012459 32475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:53.012712 32475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:53.012755 32475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:53.016942 32475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:53.017001 32475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:53.017108 32475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:00:53.022255 32475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:38593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=35397
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:53.023211 32475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:53.024119 32475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:53.033473 32485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:53.033500 32475 server_base.cc:1034] running on GCE node
W20260809 02:00:53.033505 32486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:53.033756 32488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:53.034175 32475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:53.034837 32475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:53.036036 32475 hybrid_clock.cc:648] HybridClock initialized: now 1786240853036023 us; error 23 us; skew 500 ppm
Aug 09 02:00:53 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240853, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:53.038759 32475 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:00:53.039644 32475 webserver.cc:460] Webserver started at http://127.14.175.194:35397/ using document root <none> and password file <none>
I20260809 02:00:53.040200 32475 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:53.040315 32475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:53.044196 32475 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:00:53.048520 32495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.050107 32475 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260809 02:00:53.050233 32475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "78b3c1d504b5498f87360040865e8b84"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "bd86f0e2b943326bf50c4aaf10637fde"
server_key_iv: "0b8ede36c6d1cae223c5a7e3b7866cfe"
server_key_version: "encryptionkey@0"
I20260809 02:00:53.050771 32475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:53.070775 32475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:53.073580 32475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:53.073807 32475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:53.074404 32475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:53.075295 32475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:53.075367 32475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.075438 32475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:53.075481 32475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.084481 32475 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38593
I20260809 02:00:53.084524 32620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38593 every 8 connection(s)
I20260809 02:00:53.085433 32475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:00:53.091678 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 32475
I20260809 02:00:53.092131 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:33461
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=45001
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:00:53 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240853, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:53.099928 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.087087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:50883 (local address 127.14.175.254:40249)
0809 02:00:53.087232 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.087236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.087957 (+ 721us) server_negotiation.cc:407] Connection header received
0809 02:00:53.089239 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.089243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.089311 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.089418 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:53.090792 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.091477 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.092787 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.093203 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.093347 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.096130 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:53.096134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:53.096136 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:53.096161 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:53.097763 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.098286 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.098290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.098292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.098375 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.098742 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.098745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.098747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.098927 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:53.099113 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.099602 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.099739 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:00:53.100710 32623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.087409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:50883)
0809 02:00:53.087809 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.087850 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.089028 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.089602 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.089609 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.089951 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:53.090619 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.090633 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.091632 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.091635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.092658 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.092667 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.093397 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.093409 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.093548 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.094169 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:53.094185 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:53.095949 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:53.097889 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:53.097895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:53.097910 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:53.098176 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:53.098478 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:53.098481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:53.098482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:53.098632 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:53.099113 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:53.099119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:53.099353 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.099559 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.099875 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":104,"threads_started":1}
I20260809 02:00:53.102038 32621 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:53.102272 32621 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:53.102748 32621 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:53.103879 32271 ts_manager.cc:194] Registered new tserver with Master: 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:53.104450 32271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:50883
W20260809 02:00:53.203446 32624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:00:53.203724 32624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:00:53.203801 32624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:00:53.207736 32624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:00:53.207824 32624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:00:53.207913 32624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:00:53.213119 32624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:33461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=45001
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:00:53.214118 32624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:00:53.215225 32624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:00:53.224713 32632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:53.224685 32630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:00:53.224690 32629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:00:53.225025 32624 server_base.cc:1034] running on GCE node
I20260809 02:00:53.225446 32624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:00:53.226024 32624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:00:53.227188 32624 hybrid_clock.cc:648] HybridClock initialized: now 1786240853227158 us; error 43 us; skew 500 ppm
Aug 09 02:00:53 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240853, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:00:53.229902 32624 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:00:53.230762 32624 webserver.cc:460] Webserver started at http://127.14.175.195:45001/ using document root <none> and password file <none>
I20260809 02:00:53.231382 32624 fs_manager.cc:359] Metadata directory not provided
I20260809 02:00:53.231500 32624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:00:53.235174 32624 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:00:53.237389 32640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.238555 32624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:00:53.238684 32624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "f31b41aabbb0a6b59949216f2d60b63f"
server_key_iv: "42dbf264b446444633301246fc5a5091"
server_key_version: "encryptionkey@0"
I20260809 02:00:53.239288 32624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:00:53.255522 32624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:00:53.258397 32624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:00:53.258589 32624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:00:53.259310 32624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:00:53.260138 32624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:00:53.260208 32624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.260273 32624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:00:53.260324 32624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:00:53.268952 32624 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:33461
I20260809 02:00:53.268996 32760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:33461 every 8 connection(s)
I20260809 02:00:53.269917 32624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:00:53 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240853, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:00:53.279815 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 32624
I20260809 02:00:53.283581 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.271736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:49797 (local address 127.14.175.254:40249)
0809 02:00:53.271880 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.271885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.272747 (+ 862us) server_negotiation.cc:407] Connection header received
0809 02:00:53.274016 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.274020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.274076 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.274180 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:53.275368 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.275898 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.277010 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.277241 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.277351 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.279784 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:53.279788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:53.279790 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:53.279814 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:53.281544 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.282044 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.282048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.282049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.282130 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.282464 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.282467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.282469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.282642 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:53.282749 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.283286 (+ 537us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.283412 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:00:53.284438 32763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.272185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:49797)
0809 02:00:53.272601 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.272641 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.273813 (+ 1172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.274338 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.274344 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.274672 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:00:53.275228 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.275241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.276025 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.276036 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.276875 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.276883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.277387 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.277391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.277557 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.278087 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:00:53.278103 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:00:53.279613 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:00:53.281656 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:53.281662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:53.281675 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:53.281931 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:53.282223 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:00:53.282227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:00:53.282228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:00:53.282362 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:00:53.282748 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:00:53.282754 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:00:53.283053 (+ 299us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.283242 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.283546 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
I20260809 02:00:53.285624 32761 heartbeater.cc:347] Connected to a master server at 127.14.175.254:40249
I20260809 02:00:53.285871 32761 heartbeater.cc:464] Registering TS with master...
I20260809 02:00:53.286430 32761 heartbeater.cc:511] Master 127.14.175.254:40249 requested a full tablet report, sending...
I20260809 02:00:53.287447 32271 ts_manager.cc:194] Registered new tserver with Master: 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461)
I20260809 02:00:53.287945 32271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:49797
I20260809 02:00:53.289369 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.280494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44588 (local address 127.14.175.254:40249)
0809 02:00:53.280758 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.280761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.281006 (+ 245us) server_negotiation.cc:407] Connection header received
0809 02:00:53.281117 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.281122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.281174 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.281270 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:53.281967 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.282490 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.283417 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.283686 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.283786 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.285308 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:53.285311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:53.285313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:53.285336 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:53.286820 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.288182 (+ 1362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.288188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.288192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.288273 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.288582 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.288585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.288586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.288776 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:53.289011 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.289105 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.289221 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":103,"threads_started":1}
I20260809 02:00:53.291033 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:00:53.294396 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.291571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44604 (local address 127.14.175.254:40249)
0809 02:00:53.291682 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.291686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.291862 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:00:53.291958 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.291960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.292036 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.292110 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:53.292274 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.292716 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.293463 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.293661 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.293730 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.293986 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:53.294089 (+ 103us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 02:00:53.294285 (+ 196us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44604: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 02:00:53.294461 32766 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44604: token expired
W20260809 02:00:53.294858 32190 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.175.254:40249)
I20260809 02:00:53.301519 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.295270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44606 (local address 127.14.175.254:40249)
0809 02:00:53.295386 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.295389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.295402 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:00:53.295470 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.295472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.295501 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.295561 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:00:53.296102 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.296549 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.297337 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.297557 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.297642 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.298838 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:00:53.298841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:00:53.298843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:00:53.298863 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:00:53.300168 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.300549 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.300552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.300553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.300620 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:00:53.300845 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:00:53.300847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:00:53.300848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:00:53.301006 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:00:53.301101 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.301256 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.301338 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:00:53.303936 32271 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:00:53.307227 32271 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:00:53.314951 32400 tablet_service.cc:1467] Processing CreateTablet for tablet f160aa47841a4fee837762ef241a4dba (DEFAULT_TABLE table=test-table [id=5597e72d637a4d118302b9c51d88c170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:53.315662 32400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f160aa47841a4fee837762ef241a4dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:53.318776 32356 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Bootstrap starting.
I20260809 02:00:53.319490 32478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.313614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33461 (local address 127.0.0.1:49762)
0809 02:00:53.313769 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.313788 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.313867 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.315032 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.315035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.315053 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:53.315173 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.315183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.316786 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.316791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.317779 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.317795 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.319019 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.319023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.319118 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.319163 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.319251 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.319332 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 02:00:53.319530 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.313919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.0.0.1:47134)
0809 02:00:53.314210 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.314227 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.314333 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.315134 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.315139 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.315161 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:53.315252 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.315258 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.316841 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.316845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.317992 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.318003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.319142 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.319146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.319239 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.319264 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.319314 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.319381 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":5,"thread_start_us":138,"threads_started":1}
I20260809 02:00:53.319751 32356 tablet_bootstrap.cc:654] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:53.319518 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.314057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49762 (local address 127.14.175.195:33461)
0809 02:00:53.314495 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.314526 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.314549 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:00:53.314623 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.314628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.314859 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.315053 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:53.315812 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.316667 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.317907 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.318743 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.319013 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.319155 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.319281 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.319370 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":88,"threads_started":1}
I20260809 02:00:53.320272 306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.314117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.14.175.194:38593)
0809 02:00:53.314606 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.314618 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.314642 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:00:53.314715 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.314720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.314918 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.315404 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:53.315629 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.316695 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.318146 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.319004 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.319794 (+ 790us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.319926 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.319988 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.320091 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":159,"threads_started":1}
I20260809 02:00:53.321604 32356 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: No bootstrap required, opened a new log
I20260809 02:00:53.321691 32356 ts_tablet_manager.cc:1397] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:00:53.322124 32356 raft_consensus.cc:348] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.322249 32356 raft_consensus.cc:374] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:53.322286 32356 raft_consensus.cc:729] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4fffb783f4475b7857d561494477b, State: Initialized, Role: FOLLOWER
I20260809 02:00:53.322415 32356 consensus_queue.cc:260] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.322675 32356 ts_tablet_manager.cc:1428] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:00:53.322808 32693 tablet_service.cc:1467] Processing CreateTablet for tablet f160aa47841a4fee837762ef241a4dba (DEFAULT_TABLE table=test-table [id=5597e72d637a4d118302b9c51d88c170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:53.322793 32549 tablet_service.cc:1467] Processing CreateTablet for tablet f160aa47841a4fee837762ef241a4dba (DEFAULT_TABLE table=test-table [id=5597e72d637a4d118302b9c51d88c170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:00:53.323923 32693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f160aa47841a4fee837762ef241a4dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:53.323912 32549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f160aa47841a4fee837762ef241a4dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:00:53.330766 308 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Bootstrap starting.
I20260809 02:00:53.331418 309 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Bootstrap starting.
I20260809 02:00:53.333463 308 tablet_bootstrap.cc:654] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:53.333617 309 tablet_bootstrap.cc:654] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Neither blocks nor log segments found. Creating new log.
I20260809 02:00:53.333885 32477 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:00:53.334077 32477 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.334424 308 log.cc:824] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:53.334476 309 log.cc:824] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:00:53.335417 32477 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:53.336611 309 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: No bootstrap required, opened a new log
I20260809 02:00:53.336805 309 ts_tablet_manager.cc:1397] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:00:53.337379 308 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: No bootstrap required, opened a new log
I20260809 02:00:53.337563 308 ts_tablet_manager.cc:1397] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 02:00:53.340827 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.335826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:59055 (local address 127.14.175.195:33461)
0809 02:00:53.335935 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.335938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.336300 (+ 362us) server_negotiation.cc:407] Connection header received
0809 02:00:53.336480 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.336483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.336525 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.336572 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:53.337124 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.337799 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.339407 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.340026 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.340119 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.340171 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.340572 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.340649 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:00:53.340857 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.335571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.14.175.193:60365)
0809 02:00:53.335701 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.335717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.335812 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.336230 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.336234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.336255 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:53.336400 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.336408 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.337499 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.337502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.338739 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.338750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.340465 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.340469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.340584 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.340609 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.340659 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.340742 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 02:00:53.340703 309 raft_consensus.cc:348] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.341244 309 raft_consensus.cc:374] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:53.341289 306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.335804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:60365 (local address 127.14.175.194:38593)
0809 02:00:53.335990 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.335995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.336008 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:00:53.336051 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.336055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.336096 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.336534 (+ 438us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:00:53.336630 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.337346 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.339681 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.340272 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.341027 (+ 755us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.341077 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.341112 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.341180 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 02:00:53.341306 309 raft_consensus.cc:729] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de8b925d9bb42db80a3d5a880c2d8b5, State: Initialized, Role: FOLLOWER
I20260809 02:00:53.341471 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.335570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33461 (local address 127.14.175.193:59055)
0809 02:00:53.336210 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.336225 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:00:53.336367 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:00:53.336779 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:00:53.336782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:00:53.336800 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:00:53.336973 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.336983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.337999 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.338002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.339254 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:00:53.339268 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.340290 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.340293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:00:53.340397 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.340447 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:00:53.340732 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 02:00:53.340810 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":377,"thread_start_us":110,"threads_started":1}
I20260809 02:00:53.341764 309 consensus_queue.cc:260] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.341813 32571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f160aa47841a4fee837762ef241a4dba" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b3c1d504b5498f87360040865e8b84" is_pre_election: true
I20260809 02:00:53.341823 308 raft_consensus.cc:348] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.342103 308 raft_consensus.cc:374] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:00:53.342159 308 raft_consensus.cc:729] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b3c1d504b5498f87360040865e8b84, State: Initialized, Role: FOLLOWER
I20260809 02:00:53.342159 32713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f160aa47841a4fee837762ef241a4dba" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" is_pre_election: true
I20260809 02:00:53.342407 32713 raft_consensus.cc:2454] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 0.
I20260809 02:00:53.342628 308 consensus_queue.cc:260] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.342916 309 ts_tablet_manager.cc:1428] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:00:53.342912 32571 raft_consensus.cc:2454] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 0.
I20260809 02:00:53.343160 32352 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de8b925d9bb42db80a3d5a880c2d8b5, efd4fffb783f4475b7857d561494477b; no voters:
I20260809 02:00:53.343314 32761 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
I20260809 02:00:53.343431 32477 raft_consensus.cc:2781] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:00:53.343510 32477 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:00:53.343557 32477 raft_consensus.cc:3037] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:53.343751 308 ts_tablet_manager.cc:1428] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:00:53.344055 32621 heartbeater.cc:503] Master 127.14.175.254:40249 was elected leader, sending a full tablet report...
I20260809 02:00:53.344895 32477 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.345307 32477 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 election: Requested vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
I20260809 02:00:53.345719 32713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f160aa47841a4fee837762ef241a4dba" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
I20260809 02:00:53.345846 32713 raft_consensus.cc:3037] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:53.346362 32571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f160aa47841a4fee837762ef241a4dba" candidate_uuid: "efd4fffb783f4475b7857d561494477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b3c1d504b5498f87360040865e8b84"
I20260809 02:00:53.346488 32571 raft_consensus.cc:3037] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:00:53.347213 32713 raft_consensus.cc:2454] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 1.
I20260809 02:00:53.347785 32352 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de8b925d9bb42db80a3d5a880c2d8b5, efd4fffb783f4475b7857d561494477b; no voters:
I20260809 02:00:53.347836 32571 raft_consensus.cc:2454] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd4fffb783f4475b7857d561494477b in term 1.
I20260809 02:00:53.347978 32477 raft_consensus.cc:2781] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:00:53.348240 32477 raft_consensus.cc:686] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 LEADER]: Becoming Leader. State: Replica: efd4fffb783f4475b7857d561494477b, State: Running, Role: LEADER
I20260809 02:00:53.348481 32477 consensus_queue.cc:237] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:00:53.351164 32270 catalog_manager.cc:5495] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b reported cstate change: term changed from 0 to 1, leader changed from <none> to efd4fffb783f4475b7857d561494477b (127.14.175.193). New cstate: current_term: 1 leader_uuid: "efd4fffb783f4475b7857d561494477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } health_report { overall_health: HEALTHY } } }
I20260809 02:00:53.362205 32479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.358653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.14.175.193:36019)
0809 02:00:53.358767 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:00:53.358770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:00:53.358844 (+ 74us) server_negotiation.cc:407] Connection header received
0809 02:00:53.359079 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:00:53.359081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:00:53.359131 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:00:53.359224 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:00:53.359483 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.360008 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.360794 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:00:53.361030 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:00:53.361105 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:00:53.361407 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:00:53.361778 (+ 371us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:00:53.361894 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:00:53.361981 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 02:00:53.362090 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:00:53.365793 32571 raft_consensus.cc:1261] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Refusing update from remote peer efd4fffb783f4475b7857d561494477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:53.365792 32713 raft_consensus.cc:1261] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Refusing update from remote peer efd4fffb783f4475b7857d561494477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:00:53.366460 32477 consensus_queue.cc:1035] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:53.366688 315 consensus_queue.cc:1035] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:00:53.373123 317 mvcc.cc:205] Tried to move back new op lower bound from 7316442535380701184 to 7316442535318204416. Current Snapshot: MvccSnapshot[applied={T|T < 7316442535380701184}]
I20260809 02:00:53.373193 318 mvcc.cc:205] Tried to move back new op lower bound from 7316442535380701184 to 7316442535318204416. Current Snapshot: MvccSnapshot[applied={T|T < 7316442535380701184}]
I20260809 02:00:53.382555 32271 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:53.382696 32271 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:00:53.384999 32271 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Sending DeleteTablet for 3 replicas of tablet f160aa47841a4fee837762ef241a4dba
I20260809 02:00:53.385658 32693 tablet_service.cc:1514] Processing DeleteTablet for tablet f160aa47841a4fee837762ef241a4dba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:53 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:49762
I20260809 02:00:53.385865 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 32313
I20260809 02:00:53.385955 32549 tablet_service.cc:1514] Processing DeleteTablet for tablet f160aa47841a4fee837762ef241a4dba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:00:53 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47134
I20260809 02:00:53.388482 328 tablet_replica.cc:330] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: stopping tablet replica
I20260809 02:00:53.388715 328 raft_consensus.cc:2229] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:53.388931 328 raft_consensus.cc:2258] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:53.390461 328 ts_tablet_manager.cc:1905] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:53.390506 329 tablet_replica.cc:330] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: stopping tablet replica
I20260809 02:00:53.390763 329 raft_consensus.cc:2229] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:00:53.391090 329 raft_consensus.cc:2258] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:00:53.392190 329 ts_tablet_manager.cc:1905] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:00:53.393962 328 ts_tablet_manager.cc:1918] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:53.394065 328 log.cc:1196] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/f160aa47841a4fee837762ef241a4dba
I20260809 02:00:53.394248 329 ts_tablet_manager.cc:1918] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:00:53.394356 329 log.cc:1196] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/f160aa47841a4fee837762ef241a4dba
I20260809 02:00:53.394459 328 ts_tablet_manager.cc:1939] T f160aa47841a4fee837762ef241a4dba P 2de8b925d9bb42db80a3d5a880c2d8b5: Deleting consensus metadata
I20260809 02:00:53.394709 329 ts_tablet_manager.cc:1939] T f160aa47841a4fee837762ef241a4dba P 78b3c1d504b5498f87360040865e8b84: Deleting consensus metadata
I20260809 02:00:53.395733 32257 catalog_manager.cc:4841] TS 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): tablet f160aa47841a4fee837762ef241a4dba (table test-table [id=5597e72d637a4d118302b9c51d88c170]) successfully deleted
I20260809 02:00:53.395771 32256 catalog_manager.cc:4841] TS 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): tablet f160aa47841a4fee837762ef241a4dba (table test-table [id=5597e72d637a4d118302b9c51d88c170]) successfully deleted
W20260809 02:00:53.396672 32257 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:36019 (error 108)
I20260809 02:00:53.397537 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 32475
I20260809 02:00:53.397769 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:00:53.397415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:36019 (local address 127.0.0.1:59990)
0809 02:00:53.397588 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:00:53.397671 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 02:00:53.398913 32257 catalog_manager.cc:4584] TS efd4fffb783f4475b7857d561494477b (127.14.175.193:36019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f160aa47841a4fee837762ef241a4dba: Network error: Client connection negotiation failed: client connection to 127.14.175.193:36019: connect: Connection refused (error 111)
I20260809 02:00:53.405201 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 32624
I20260809 02:00:53.412977 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 32236
I20260809 02:01:13.421892 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--webserver_interface=127.14.175.254
--webserver_port=33717
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:13.531881 331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:13.532148 331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:13.532188 331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:13.536195 331 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:01:13.536247 331 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:01:13.536262 331 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:01:13.536276 331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:13.536294 331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:13.536347 331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:13.536377 331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:13.536410 331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:13.541558 331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=33717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:13.542548 331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:13.543608 331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:13.552140 341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:13.552292 336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:13.552337 337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:13.552388 331 server_base.cc:1034] running on GCE node
I20260809 02:01:13.553328 331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:13.554371 331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:13.555536 331 hybrid_clock.cc:648] HybridClock initialized: now 1786240873555524 us; error 24 us; skew 500 ppm
Aug 09 02:01:13 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240873, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:13.561806 331 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:13.562724 331 webserver.cc:460] Webserver started at http://127.14.175.254:33717/ using document root <none> and password file <none>
I20260809 02:01:13.563289 331 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:13.563408 331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:13.567265 331 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:01:13.569386 350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:13.570632 331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:13.570763 331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "b43663055c154ec1b422610652736c87"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "6a2f08f5bb9404cdf6ca2869aa7c5ec8"
server_key_iv: "49a9cd1b5ce590bf0db26c57b0407021"
server_key_version: "encryptionkey@0"
I20260809 02:01:13.571386 331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:13.590068 331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:13.593096 331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:13.593318 331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:13.600744 331 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40249
I20260809 02:01:13.601065 404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40249 every 8 connection(s)
I20260809 02:01:13.601835 331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:13.606094 405 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:01:13.607985 405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap starting.
I20260809 02:01:13.609089 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 331
I20260809 02:01:13.609627 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:36019
--local_ip_for_outbound_sockets=127.14.175.193
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=43193
--webserver_interface=127.14.175.193
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:01:13.627118 405 log.cc:824] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:13.638125 405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:01:13.638533 405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Bootstrap complete.
I20260809 02:01:13.642601 405 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:01:13.643044 405 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43663055c154ec1b422610652736c87, State: Initialized, Role: FOLLOWER
I20260809 02:01:13.643575 405 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:01:13.643692 405 raft_consensus.cc:388] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:13.643771 405 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:13.643886 405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:01:13.645754 405 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:01:13.646063 405 leader_election.cc:302] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b43663055c154ec1b422610652736c87; no voters:
I20260809 02:01:13.646354 405 leader_election.cc:288] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:01:13.646500 409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:01:13.646754 409 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [term 3 LEADER]: Becoming Leader. State: Replica: b43663055c154ec1b422610652736c87, State: Running, Role: LEADER
I20260809 02:01:13.647126 409 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } }
I20260809 02:01:13.647552 405 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:13.648042 409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43663055c154ec1b422610652736c87. Latest consensus state: current_term: 3 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:01:13.648166 409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:13.648537 414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:13.648586 410 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b43663055c154ec1b422610652736c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43663055c154ec1b422610652736c87" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40249 } } }
I20260809 02:01:13.648761 410 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:13.653517 414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:13.654269 414 catalog_manager.cc:1259] Loaded cluster ID: 98080068a2e948d4b5cad893b99499e8
I20260809 02:01:13.654331 414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:13.657120 414 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:13.657852 414 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Loaded TSK: 0
I20260809 02:01:13.657936 414 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b43663055c154ec1b422610652736c87: Loaded TSK: 1
F20260809 02:01:13.658622 414 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f80ead119ad google::LogMessage::Fail() at ??:0
@ 0x7f80ead1488a google::LogMessage::SendToLog() at ??:0
@ 0x7f80ead114de google::LogMessage::Flush() at ??:0
@ 0x7f80ead12a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f80ed9d518d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f80ed9cdf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f80f56767bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f80f565099c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f80f5651178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f80f5692df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f80f56b182b std::function<>::operator()() at ??:0
@ 0x7f80f5650b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f80f5651f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f80f564e579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f80f5692640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f80ecf633d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f80ecf63c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f80ecf653f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f80ecf54512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f80ee5986db start_thread at ??:0
@ 0x7f80e980f61f clone at ??:0
W20260809 02:01:13.761155 407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:13.761391 407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:13.761438 407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:13.765754 407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:13.765810 407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:13.765897 407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:13.771158 407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:36019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=43193
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:13.772159 407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:13.773157 407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:13.782437 460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:13.782445 459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:13.782436 463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:13.783113 407 server_base.cc:1034] running on GCE node
I20260809 02:01:13.783612 407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:13.784443 407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:13.785670 407 hybrid_clock.cc:648] HybridClock initialized: now 1786240873785632 us; error 51 us; skew 500 ppm
Aug 09 02:01:13 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240873, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:13.789469 407 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:01:13.790614 407 webserver.cc:460] Webserver started at http://127.14.175.193:43193/ using document root <none> and password file <none>
I20260809 02:01:13.791450 407 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:13.791567 407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:13.796895 407 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 02:01:13.799886 470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:13.801515 407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:01:13.801648 407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "efd4fffb783f4475b7857d561494477b"
format_stamp: "Formatted at 2026-08-09 02:00:31 on dist-test-slave-2w3w"
server_key: "4298364b310991212b209992d847ab98"
server_key_iv: "a50dc64b7a47e1a17a0487aaae186038"
server_key_version: "encryptionkey@0"
I20260809 02:01:13.802444 407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:13.827281 407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:13.831146 407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:13.831370 407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:13.832190 407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:13.833483 477 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:01:13.837453 407 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:01:13.837530 407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20260809 02:01:13.837595 407 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:01:13.839645 407 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:01:13.839725 407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:13.840023 477 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Bootstrap starting.
I20260809 02:01:13.851821 407 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:36019
I20260809 02:01:13.852733 407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:13.853499 593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:36019 every 8 connection(s)
I20260809 02:01:13.858330 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 407
I20260809 02:01:13.858780 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:38593
--local_ip_for_outbound_sockets=127.14.175.194
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=35397
--webserver_interface=127.14.175.194
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:01:13.861932 477 log.cc:824] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:13.870983 477 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:01:13.871415 477 tablet_bootstrap.cc:492] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Bootstrap complete.
I20260809 02:01:13.872917 477 ts_tablet_manager.cc:1397] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Time spent bootstrapping tablet: real 0.033s user 0.026s sys 0.004s
I20260809 02:01:13.876096 477 raft_consensus.cc:348] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:13.876631 477 raft_consensus.cc:729] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4fffb783f4475b7857d561494477b, State: Initialized, Role: FOLLOWER
I20260809 02:01:13.877152 477 consensus_queue.cc:260] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:13.878187 477 ts_tablet_manager.cc:1428] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 02:01:13.913836 596 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:01:13.854901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:56317)
0809 02:01:13.855449 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:13.855502 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:13.856310 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:13.913074 (+ 56764us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":157,"threads_started":1}
W20260809 02:01:13.914376 594 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:40249 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:40249: Client connection negotiation failed: client connection to 127.14.175.254:40249: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:01:13.915213 596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:13.914941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:57389)
0809 02:01:13.915096 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:13.915159 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 02:01:13.915902 596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:13.915651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:37541)
0809 02:01:13.915764 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:13.915808 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:01:13.916105 594 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:01:13.974503 597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:13.974745 597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:13.974843 597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:13.978735 597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:13.978785 597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:13.978945 597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:13.983906 597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:38593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=35397
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:13.984843 597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:13.985788 597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:13.995339 607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:13.995528 597 server_base.cc:1034] running on GCE node
W20260809 02:01:13.995340 604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:13.995343 605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:13.996165 597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:13.996742 597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:13.997979 597 hybrid_clock.cc:648] HybridClock initialized: now 1786240873997964 us; error 30 us; skew 500 ppm
Aug 09 02:01:13 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240873, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:14.000690 597 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:01:14.001528 597 webserver.cc:460] Webserver started at http://127.14.175.194:35397/ using document root <none> and password file <none>
I20260809 02:01:14.002058 597 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:14.002147 597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:14.005748 597 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:14.007885 615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.009202 597 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:14.009351 597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "78b3c1d504b5498f87360040865e8b84"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "bd86f0e2b943326bf50c4aaf10637fde"
server_key_iv: "0b8ede36c6d1cae223c5a7e3b7866cfe"
server_key_version: "encryptionkey@0"
I20260809 02:01:14.009903 597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:14.054594 597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:14.057765 597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:14.057991 597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:14.058575 597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:14.059453 597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:14.059525 597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.059597 597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:14.059653 597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.068768 597 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38593
I20260809 02:01:14.068796 736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38593 every 8 connection(s)
I20260809 02:01:14.069721 597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:14.073505 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.071785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:51487)
0809 02:01:14.072224 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.072345 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":119,"threads_started":1}
W20260809 02:01:14.073909 737 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:40249 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:40249: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
I20260809 02:01:14.074497 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.074278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:60043)
0809 02:01:14.074390 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.074441 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:01:14.075111 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.074896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:55061)
0809 02:01:14.075010 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.075055 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:01:14.075276 737 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:01:14.079704 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 597
I20260809 02:01:14.080090 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:33461
--local_ip_for_outbound_sockets=127.14.175.195
--tserver_master_addrs=127.14.175.254:40249
--webserver_port=45001
--webserver_interface=127.14.175.195
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:14.192895 741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:14.193126 741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:14.193166 741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:14.197124 741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:14.197175 741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:14.197229 741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:14.202302 741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:33461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=45001
--tserver_master_addrs=127.14.175.254:40249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:14.203253 741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:14.204154 741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:14.213559 746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:14.213619 749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:14.213578 747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:14.214006 741 server_base.cc:1034] running on GCE node
I20260809 02:01:14.214421 741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:14.215135 741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:14.216346 741 hybrid_clock.cc:648] HybridClock initialized: now 1786240874216311 us; error 29 us; skew 500 ppm
Aug 09 02:01:14 dist-test-slave-2w3w krb5kdc[31648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:14.219143 741 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:01:14.219971 741 webserver.cc:460] Webserver started at http://127.14.175.195:45001/ using document root <none> and password file <none>
I20260809 02:01:14.220530 741 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:14.220592 741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:14.224493 741 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:01:14.226534 758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.227775 741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:01:14.227964 741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "2de8b925d9bb42db80a3d5a880c2d8b5"
format_stamp: "Formatted at 2026-08-09 02:00:32 on dist-test-slave-2w3w"
server_key: "f31b41aabbb0a6b59949216f2d60b63f"
server_key_iv: "42dbf264b446444633301246fc5a5091"
server_key_version: "encryptionkey@0"
I20260809 02:01:14.228541 741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:14.257861 741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:14.261117 741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:14.261351 741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:14.261988 741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:14.262888 741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:14.262966 741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.263092 741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:14.263149 741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:14.272784 741 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:33461
I20260809 02:01:14.272815 877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:33461 every 8 connection(s)
I20260809 02:01:14.273782 741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:14.277107 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 741
I20260809 02:01:14.277947 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.275869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:36875)
0809 02:01:14.276799 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.276961 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":593,"threads_started":1}
W20260809 02:01:14.278434 878 heartbeater.cc:644] Failed to heartbeat to 127.14.175.254:40249 (0 consecutive failures): Network error: Failed to ping master at 127.14.175.254:40249: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
I20260809 02:01:14.279109 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.278813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:55691)
0809 02:01:14.278975 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.279035 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:01:14.279891 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.279604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:59669)
0809 02:01:14.279762 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.279818 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260809 02:01:14.280170 878 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:01:14.917060 882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:14.916650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:33623)
0809 02:01:14.916907 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:14.916961 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":78,"threads_started":1}
I20260809 02:01:15.076102 883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.075751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:52851)
0809 02:01:15.075960 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:15.076010 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260809 02:01:15.281186 884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.280702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:51185)
0809 02:01:15.281000 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:15.281057 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":85,"threads_started":1}
I20260809 02:01:15.542665 885 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:15.542865 885 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:15.543972 885 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
Aug 09 02:01:15 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240873, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.195@KRBTEST.COM
Aug 09 02:01:15 dist-test-slave-2w3w krb5kdc[31648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240873, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.194@KRBTEST.COM
I20260809 02:01:15.558897 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.544199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38593 (local address 127.14.175.193:38467)
0809 02:01:15.544499 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:15.544515 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:15.544635 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:15.546215 (+ 1580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:15.546221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:15.546801 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:15.547349 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:15.547364 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.548873 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.548876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:15.549791 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:15.549801 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.550538 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.550542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:15.550778 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:15.551398 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:15.551415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:15.553433 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:15.555745 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:15.555751 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:15.555765 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:15.556245 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:15.556682 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:15.556685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:15.556687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:15.556925 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:15.557680 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:15.557686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:15.558110 (+ 424us) client_negotiation.cc:769] Sending connection context
0809 02:01:15.558328 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 02:01:15.558702 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":256,"spinlock_wait_cycles":51072,"thread_start_us":77,"threads_started":1}
I20260809 02:01:15.558954 888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.544306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:34385 (local address 127.14.175.195:33461)
0809 02:01:15.544772 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:15.544793 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:15.544831 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:01:15.545510 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:15.545516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:15.545839 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:15.546163 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:15.547527 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.548741 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.549931 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.550393 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.550579 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:15.553361 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:15.553367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:15.553378 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:15.553407 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:15.555599 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:15.556390 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:15.556396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:15.556402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:15.556568 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:15.557039 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:15.557042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:15.557044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:15.557546 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:15.557685 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:15.558481 (+ 796us) server_negotiation.cc:299] Negotiation successful
0809 02:01:15.558777 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":86,"threads_started":1}
I20260809 02:01:15.559458 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.544492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:38467 (local address 127.14.175.194:38593)
0809 02:01:15.544856 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:15.544880 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:15.544912 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:01:15.545544 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:15.545549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:15.545840 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:15.546157 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:15.547524 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.548712 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.549917 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.550397 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.550571 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:15.553631 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:15.553637 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:15.553654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:15.553689 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:15.555629 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:15.556390 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:15.556396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:15.556402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:15.556569 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:15.557039 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:15.557042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:15.557044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:15.557546 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:15.557685 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:15.558481 (+ 796us) server_negotiation.cc:299] Negotiation successful
0809 02:01:15.558765 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":94,"threads_started":1}
I20260809 02:01:15.559684 886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.544152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:33461 (local address 127.14.175.193:34385)
0809 02:01:15.544472 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:15.544487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:15.544601 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:15.546217 (+ 1616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:15.546222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:15.546794 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:15.547349 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:15.547365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.548867 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.548870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:15.549798 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:15.549808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:15.550537 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:15.550543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:15.550858 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:15.551559 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:15.551571 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:15.553088 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:15.555747 (+ 2659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:15.555751 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:15.555765 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:15.556245 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:15.556682 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:15.556685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:15.556687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:15.556925 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:15.557680 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:15.557686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:15.558110 (+ 424us) client_negotiation.cc:769] Sending connection context
0809 02:01:15.558328 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 02:01:15.559493 (+ 1165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":1020,"spinlock_wait_cycles":11264,"thread_start_us":92,"threads_started":1}
W20260809 02:01:15.561775 473 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
W20260809 02:01:15.561942 474 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
I20260809 02:01:15.562036 474 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4fffb783f4475b7857d561494477b; no voters: 2de8b925d9bb42db80a3d5a880c2d8b5, 78b3c1d504b5498f87360040865e8b84
I20260809 02:01:15.562342 885 raft_consensus.cc:2726] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:01:15.918155 886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:15.917895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:40631)
0809 02:01:15.918019 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:15.918072 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 02:01:16.077096 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:16.076734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:40159)
0809 02:01:16.076964 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:16.077017 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":99,"threads_started":1}
I20260809 02:01:16.282346 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:16.281908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:55253)
0809 02:01:16.282213 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:16.282266 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":89,"threads_started":1}
I20260809 02:01:16.919348 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:16.918883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:55175)
0809 02:01:16.919188 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:16.919243 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":131,"threads_started":1}
I20260809 02:01:17.078191 894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:17.077817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:44555)
0809 02:01:17.078059 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:17.078112 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":80,"threads_started":1}
I20260809 02:01:17.283638 895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:17.283205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:35469)
0809 02:01:17.283482 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:17.283539 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":92,"threads_started":1}
I20260809 02:01:17.482017 896 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:17.482156 896 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:17.482614 896 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
W20260809 02:01:17.483614 474 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
W20260809 02:01:17.483739 473 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
I20260809 02:01:17.483815 473 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4fffb783f4475b7857d561494477b; no voters: 2de8b925d9bb42db80a3d5a880c2d8b5, 78b3c1d504b5498f87360040865e8b84
I20260809 02:01:17.483991 896 raft_consensus.cc:2726] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:01:17.920605 897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:17.920182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:34953)
0809 02:01:17.920459 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:17.920511 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":122,"threads_started":1}
I20260809 02:01:18.079412 898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:18.079048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:41969)
0809 02:01:18.079278 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:18.079331 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":71,"threads_started":1}
I20260809 02:01:18.284795 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:18.284441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:60805)
0809 02:01:18.284669 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:18.284717 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":73,"threads_started":1}
I20260809 02:01:18.921936 901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:18.921516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:44401)
0809 02:01:18.921790 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:18.921843 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":73,"threads_started":1}
I20260809 02:01:19.080476 902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:19.080107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:59201)
0809 02:01:19.080337 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:19.080389 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
I20260809 02:01:19.286041 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:19.285606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:54157)
0809 02:01:19.285882 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:19.285939 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":85,"threads_started":1}
I20260809 02:01:19.727814 904 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:19.727949 904 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:19.728443 904 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
W20260809 02:01:19.729250 473 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
W20260809 02:01:19.729348 474 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
I20260809 02:01:19.729444 474 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4fffb783f4475b7857d561494477b; no voters: 2de8b925d9bb42db80a3d5a880c2d8b5, 78b3c1d504b5498f87360040865e8b84
I20260809 02:01:19.729611 904 raft_consensus.cc:2726] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:01:19.923206 905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:19.922718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:34011)
0809 02:01:19.923053 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:19.923111 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":103,"threads_started":1}
I20260809 02:01:20.081573 906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:20.081175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:41439)
0809 02:01:20.081416 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:20.081471 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":83,"threads_started":1}
I20260809 02:01:20.287194 907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:20.286700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:35517)
0809 02:01:20.287045 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:20.287104 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":72,"threads_started":1}
I20260809 02:01:20.924309 908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:20.923911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:46037)
0809 02:01:20.924156 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:20.924212 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":85,"threads_started":1}
I20260809 02:01:21.082758 909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:21.082309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:58363)
0809 02:01:21.082608 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:21.082664 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":71,"threads_started":1}
I20260809 02:01:21.288367 910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:21.287909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:35497)
0809 02:01:21.288205 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:21.288258 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":79,"threads_started":1}
I20260809 02:01:21.925465 911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:21.925053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:58197)
0809 02:01:21.925309 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:21.925371 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
I20260809 02:01:22.083840 912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:22.083467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:46951)
0809 02:01:22.083698 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:22.083750 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260809 02:01:22.289495 913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:22.289097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:34395)
0809 02:01:22.289356 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:22.289409 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":89,"threads_started":1}
I20260809 02:01:22.926836 914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:22.926402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:60763)
0809 02:01:22.926681 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:22.926741 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":77,"threads_started":1}
I20260809 02:01:23.084868 915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:23.084504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:40759)
0809 02:01:23.084730 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:23.084781 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":74,"threads_started":1}
I20260809 02:01:23.290668 916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:23.290261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:60701)
0809 02:01:23.290526 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:23.290580 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":96,"threads_started":1}
I20260809 02:01:23.928249 917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:23.927710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:36037)
0809 02:01:23.928072 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:23.928152 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":126,"threads_started":1}
I20260809 02:01:24.086127 919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:24.085706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:58581)
0809 02:01:24.085953 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:24.086022 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":74,"threads_started":1}
I20260809 02:01:24.118192 920 raft_consensus.cc:482] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:24.118360 920 raft_consensus.cc:504] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de8b925d9bb42db80a3d5a880c2d8b5" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 33461 } } peers { permanent_uuid: "78b3c1d504b5498f87360040865e8b84" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38593 } } peers { permanent_uuid: "efd4fffb783f4475b7857d561494477b" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 36019 } }
I20260809 02:01:24.118814 920 leader_election.cc:288] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461), 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593)
W20260809 02:01:24.119590 473 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2de8b925d9bb42db80a3d5a880c2d8b5 (127.14.175.195:33461): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
W20260809 02:01:24.119700 474 leader_election.cc:341] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78b3c1d504b5498f87360040865e8b84 (127.14.175.194:38593): Not found: Tablet not found: f160aa47841a4fee837762ef241a4dba
I20260809 02:01:24.119763 474 leader_election.cc:302] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4fffb783f4475b7857d561494477b; no voters: 2de8b925d9bb42db80a3d5a880c2d8b5, 78b3c1d504b5498f87360040865e8b84
I20260809 02:01:24.119910 920 raft_consensus.cc:2726] T f160aa47841a4fee837762ef241a4dba P efd4fffb783f4475b7857d561494477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:01:24.291812 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:24.291419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:41727)
0809 02:01:24.291659 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:24.291713 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":78,"threads_started":1}
I20260809 02:01:24.929487 923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:24.929058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:41035)
0809 02:01:24.929332 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:24.929393 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":78,"threads_started":1}
I20260809 02:01:25.087530 924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:25.087122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:58767)
0809 02:01:25.087356 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:25.087410 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":71,"threads_started":1}
I20260809 02:01:25.292908 925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:25.292496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:58689)
0809 02:01:25.292764 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:25.292819 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":75,"threads_started":1}
I20260809 02:01:25.931041 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:25.930505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:38805)
0809 02:01:25.930796 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:25.930865 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":87,"threads_started":1}
I20260809 02:01:26.088851 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:26.088390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:54161)
0809 02:01:26.088682 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:26.088759 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":76,"threads_started":1}
I20260809 02:01:26.294164 929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:26.293740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:38243)
0809 02:01:26.294010 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:26.294075 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":86,"threads_started":1}
I20260809 02:01:26.932410 930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:26.931911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:60679)
0809 02:01:26.932234 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:26.932312 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
I20260809 02:01:27.090246 931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:27.089782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:35193)
0809 02:01:27.090095 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:27.090155 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":117,"threads_started":1}
I20260809 02:01:27.295512 932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:27.295068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:39105)
0809 02:01:27.295358 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:27.295422 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":95,"threads_started":1}
I20260809 02:01:27.933569 933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:27.933151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:48195)
0809 02:01:27.933421 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:27.933473 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":124,"threads_started":1}
I20260809 02:01:28.091385 934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:28.090994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:55477)
0809 02:01:28.091238 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:28.091294 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":78,"threads_started":1}
I20260809 02:01:28.296713 935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:28.296300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:48863)
0809 02:01:28.296569 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:28.296625 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":102,"threads_started":1}
I20260809 02:01:28.934916 936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:28.934486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.193:35397)
0809 02:01:28.934736 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:28.934800 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
I20260809 02:01:29.092571 937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:29.092171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.194:46385)
0809 02:01:29.092421 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:29.092479 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":70,"threads_started":1}
I20260809 02:01:29.287536 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 407
I20260809 02:01:29.294950 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 597
I20260809 02:01:29.299028 939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:29.298481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40249 (local address 127.14.175.195:59869)
0809 02:01:29.298779 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:29.298855 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.254:40249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":66,"threads_started":1}
I20260809 02:01:29.302572 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 741
2026-08-09T02:01:29Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59104 ms)
[----------] 30 tests from SecurityITest (239788 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:29 dist-test-slave-2w3w krb5kdc[942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:29 dist-test-slave-2w3w krb5kdc[942](info): set up 2 sockets
Aug 09 02:01:29 dist-test-slave-2w3w krb5kdc[942](info): commencing operation
krb5kdc: starting...
W20260809 02:01:30.392954 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:30 dist-test-slave-2w3w krb5kdc[942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:01:30.517479 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37553
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:37553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:30.627194 956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:30.627439 956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:30.627480 956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:30.631352 956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:30.631404 956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:30.631423 956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:30.631439 956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:30.631455 956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:30.636566 956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:37553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:30.637470 956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:30.638393 956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:30.646618 961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:30.646643 964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:30.646605 966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:30.647027 956 server_base.cc:1034] running on GCE node
I20260809 02:01:30.647596 956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:30.648644 956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:30.649866 956 hybrid_clock.cc:648] HybridClock initialized: now 1786240890649843 us; error 44 us; skew 500 ppm
Aug 09 02:01:30 dist-test-slave-2w3w krb5kdc[942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240890, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:30.652719 956 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:30.653518 956 webserver.cc:460] Webserver started at http://127.14.175.254:41215/ using document root <none> and password file <none>
I20260809 02:01:30.654021 956 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:30.654078 956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:30.654234 956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:30.656312 956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "94f23f6cb6b74efd95b171fdf6b33b07"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "37aec2aa5b7d4afcb898e7ecfa9c5a52"
server_key_iv: "9b395fe5664e31068277b5fdb36d910c"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.656838 956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "94f23f6cb6b74efd95b171fdf6b33b07"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "37aec2aa5b7d4afcb898e7ecfa9c5a52"
server_key_iv: "9b395fe5664e31068277b5fdb36d910c"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.660431 956 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:01:30.662783 973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:30.664137 956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:30.664278 956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "94f23f6cb6b74efd95b171fdf6b33b07"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "37aec2aa5b7d4afcb898e7ecfa9c5a52"
server_key_iv: "9b395fe5664e31068277b5fdb36d910c"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.664384 956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:30.687247 956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:30.690299 956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:30.690516 956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:30.697970 956 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:37553
I20260809 02:01:30.697999 1027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:37553 every 8 connection(s)
I20260809 02:01:30.698937 956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:30.701805 1028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:30.703792 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 956
I20260809 02:01:30.703969 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:30.704356 15039 external_mini_cluster.cc:1428] Setting key 1d84e880715760d692b2cdc6d0b67078
I20260809 02:01:30.708752 1028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: Bootstrap starting.
I20260809 02:01:30.711465 1028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:30.712224 1028 log.cc:824] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:30.714269 1028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: No bootstrap required, opened a new log
Aug 09 02:01:30 dist-test-slave-2w3w krb5kdc[942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:30.719326 1028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } }
I20260809 02:01:30.719605 1028 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:30.719656 1028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f23f6cb6b74efd95b171fdf6b33b07, State: Initialized, Role: FOLLOWER
I20260809 02:01:30.720134 1028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } }
I20260809 02:01:30.720285 1028 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:30.720346 1028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:30.720438 1028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:30.720633 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:30.706032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36378 (local address 127.14.175.254:37553)
0809 02:01:30.706478 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:30.706499 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:30.706543 (+ 44us) server_negotiation.cc:407] Connection header received
0809 02:01:30.707621 (+ 1078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:30.707646 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:30.708069 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:30.708434 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:30.709222 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.710715 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.711706 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.712237 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.712426 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:30.714981 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:30.714988 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:30.715018 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:30.715051 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:30.717257 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:30.717713 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:30.717719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:30.717725 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:30.717883 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:30.718236 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:30.718240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:30.718242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:30.718799 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:30.719050 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:30.719337 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:01:30.719649 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":118,"threads_started":1}
I20260809 02:01:30.721478 1028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } }
I20260809 02:01:30.721879 1028 leader_election.cc:302] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94f23f6cb6b74efd95b171fdf6b33b07; no voters:
I20260809 02:01:30.722208 1028 leader_election.cc:288] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:30.722329 1033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:30.722587 1033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [term 1 LEADER]: Becoming Leader. State: Replica: 94f23f6cb6b74efd95b171fdf6b33b07, State: Running, Role: LEADER
I20260809 02:01:30.722934 1033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } }
I20260809 02:01:30.723444 1028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:30.724610 1034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } } }
I20260809 02:01:30.724745 1034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:30.725168 1044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:30.725134 1035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94f23f6cb6b74efd95b171fdf6b33b07. Latest consensus state: current_term: 1 leader_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f23f6cb6b74efd95b171fdf6b33b07" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37553 } } }
I20260809 02:01:30.725275 1035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:30.728291 1044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:30.733556 1044 catalog_manager.cc:1347] Generated new cluster ID: 4fbf02997a154b77bf93c603aebe8784
I20260809 02:01:30.733619 1044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:30.751436 1044 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:30.752691 1044 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:30.757508 1044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: Generated new TSK 0
I20260809 02:01:30.758219 1044 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:01:30.792163 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:30.904384 1057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:30.904633 1057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:30.904697 1057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:30.908738 1057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:30.908798 1057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:30.908854 1057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:30.914068 1057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:30.915197 1057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:30.916208 1057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:30.925908 1066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:30.926072 1057 server_base.cc:1034] running on GCE node
W20260809 02:01:30.925997 1063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:30.925927 1064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:30.926579 1057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:30.927258 1057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:30.928417 1057 hybrid_clock.cc:648] HybridClock initialized: now 1786240890928409 us; error 37 us; skew 500 ppm
Aug 09 02:01:30 dist-test-slave-2w3w krb5kdc[942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240890, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:30.931134 1057 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:01:30.931917 1057 webserver.cc:460] Webserver started at http://127.14.175.193:45957/ using document root <none> and password file <none>
I20260809 02:01:30.932442 1057 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:30.932502 1057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:30.932662 1057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:30.934587 1057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "b626cbee24e249fd8cbb142c79a47b7e"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "d2454cd827fc1aebab504dde3c705a72"
server_key_iv: "a7efbe2564df5f0d70ec743da9afd42f"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.935181 1057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "b626cbee24e249fd8cbb142c79a47b7e"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "d2454cd827fc1aebab504dde3c705a72"
server_key_iv: "a7efbe2564df5f0d70ec743da9afd42f"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.938719 1057 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:01:30.941040 1073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:30.942212 1057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:30.942312 1057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "b626cbee24e249fd8cbb142c79a47b7e"
format_stamp: "Formatted at 2026-08-09 02:01:30 on dist-test-slave-2w3w"
server_key: "d2454cd827fc1aebab504dde3c705a72"
server_key_iv: "a7efbe2564df5f0d70ec743da9afd42f"
server_key_version: "encryptionkey@0"
I20260809 02:01:30.942451 1057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:30.952246 1057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:30.955420 1057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:30.955622 1057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:30.956187 1057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:30.956964 1057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:30.957011 1057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:30.957077 1057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:30.957106 1057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:30.966074 1057 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:43319
I20260809 02:01:30.966106 1196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:43319 every 8 connection(s)
I20260809 02:01:30.966948 1057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:30.968647 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1057
I20260809 02:01:30.968802 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:30.969179 15039 external_mini_cluster.cc:1428] Setting key f86f66f20dd630c1817a67f4165a7058
Aug 09 02:01:30 dist-test-slave-2w3w krb5kdc[942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240890, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 02:01:30.982637 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:30.969178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:48045 (local address 127.14.175.254:37553)
0809 02:01:30.969347 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:30.969352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:30.970229 (+ 877us) server_negotiation.cc:407] Connection header received
0809 02:01:30.972219 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:30.972221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:30.972268 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:30.972327 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:30.973744 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.974292 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.975622 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.975865 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.975980 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:30.978981 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:30.978985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:30.978988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:30.979021 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:30.980501 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:30.981065 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:30.981067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:30.981068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:30.981141 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:30.981441 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:30.981444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:30.981445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:30.981617 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:30.981717 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:30.982224 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 02:01:30.982382 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:01:30.984920 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:30.969610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37553 (local address 127.14.175.193:48045)
0809 02:01:30.970090 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:30.970133 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:30.971977 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:30.972532 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:30.972544 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:30.973061 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:30.973590 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:30.973604 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.974427 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.974430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:30.975479 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:30.975493 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:30.976021 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:30.976026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:30.976204 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:30.976908 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:30.976925 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:30.978773 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:30.980609 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:30.980613 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:30.980624 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:30.980972 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:30.981223 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:30.981225 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:30.981227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:30.981359 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:30.981739 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:30.981747 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:30.981991 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 02:01:30.982155 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 02:01:30.982513 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":120,"threads_started":1}
I20260809 02:01:30.986222 1197 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37553
I20260809 02:01:30.986477 1197 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:30.987068 1197 heartbeater.cc:511] Master 127.14.175.254:37553 requested a full tablet report, sending...
I20260809 02:01:30.988794 991 ts_manager.cc:194] Registered new tserver with Master: b626cbee24e249fd8cbb142c79a47b7e (127.14.175.193:43319)
I20260809 02:01:30.990466 991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:48045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 02:01:30.998205 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:31.111182 1202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:31.111418 1202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:31.111466 1202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:31.115401 1202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:31.115454 1202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:31.115509 1202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:31.120522 1202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:31.121417 1202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:31.122524 1202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:31.132057 1212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:31.132081 1207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:31.132077 1208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:31.132364 1202 server_base.cc:1034] running on GCE node
I20260809 02:01:31.132848 1202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:31.133462 1202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:31.134660 1202 hybrid_clock.cc:648] HybridClock initialized: now 1786240891134644 us; error 36 us; skew 500 ppm
Aug 09 02:01:31 dist-test-slave-2w3w krb5kdc[942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:31.137391 1202 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:01:31.138209 1202 webserver.cc:460] Webserver started at http://127.14.175.194:42077/ using document root <none> and password file <none>
I20260809 02:01:31.138763 1202 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:31.138856 1202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:31.139140 1202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:31.141127 1202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "dfa13bbc01dd498f93fd4ac2c898eb10"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "4ddebbf32f092c64e03b868c4b8c2c10"
server_key_iv: "32d35416f3bab22e3bad3524a3fce2d5"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.141701 1202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "dfa13bbc01dd498f93fd4ac2c898eb10"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "4ddebbf32f092c64e03b868c4b8c2c10"
server_key_iv: "32d35416f3bab22e3bad3524a3fce2d5"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.145316 1202 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:01:31.147684 1219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.148862 1202 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:31.148998 1202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "dfa13bbc01dd498f93fd4ac2c898eb10"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "4ddebbf32f092c64e03b868c4b8c2c10"
server_key_iv: "32d35416f3bab22e3bad3524a3fce2d5"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.149112 1202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:31.165729 1202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:31.168862 1202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:31.169062 1202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:31.169641 1202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:31.170502 1202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:31.170578 1202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.170652 1202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:31.170696 1202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.179716 1202 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:38927
I20260809 02:01:31.179745 1340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:38927 every 8 connection(s)
I20260809 02:01:31.180596 1202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:31.185544 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1202
I20260809 02:01:31.185721 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:31.186111 15039 external_mini_cluster.cc:1428] Setting key 67f491d90523064eca11aca661a6063a
Aug 09 02:01:31 dist-test-slave-2w3w krb5kdc[942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:31.195169 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.182338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:50503 (local address 127.14.175.254:37553)
0809 02:01:31.182468 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.182479 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.183310 (+ 831us) server_negotiation.cc:407] Connection header received
0809 02:01:31.184622 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.184626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.184676 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.184755 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:31.185975 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.186683 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.188008 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.188230 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.188340 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.191238 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:31.191242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:31.191245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:31.191276 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:31.192749 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.193424 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.193431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.193435 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.193546 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.193895 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.193901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.193904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.194174 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:31.194296 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.194785 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.194941 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:01:31.195812 1343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.182665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37553 (local address 127.14.175.194:50503)
0809 02:01:31.183158 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.183199 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.184395 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.184918 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.184924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.185276 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:31.185782 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.185816 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.186810 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.186814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.187877 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.187887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.188397 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.188402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.188560 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.189146 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:31.189163 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:31.191072 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:31.192875 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:31.192885 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:31.192900 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:31.193279 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:31.193647 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:31.193649 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:31.193651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:31.193779 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:31.194289 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:31.194302 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:31.194514 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.194658 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.194912 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":116,"threads_started":1}
I20260809 02:01:31.196923 1341 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37553
I20260809 02:01:31.197170 1341 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 02:01:31.197666 1341 heartbeater.cc:511] Master 127.14.175.254:37553 requested a full tablet report, sending...
I20260809 02:01:31.198704 991 ts_manager.cc:194] Registered new tserver with Master: dfa13bbc01dd498f93fd4ac2c898eb10 (127.14.175.194:38927)
I20260809 02:01:31.199298 991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:50503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:01:31.215469 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:31.325311 1346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:31.325613 1346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:31.325657 1346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:31.329782 1346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:31.329835 1346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:31.329891 1346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:31.335021 1346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:31.335901 1346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:31.336797 1346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:31.345971 1353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:31.346014 1356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:31.346029 1354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:31.346306 1346 server_base.cc:1034] running on GCE node
I20260809 02:01:31.346688 1346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:31.347383 1346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:31.348533 1346 hybrid_clock.cc:648] HybridClock initialized: now 1786240891348506 us; error 42 us; skew 500 ppm
Aug 09 02:01:31 dist-test-slave-2w3w krb5kdc[942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:31.351253 1346 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:01:31.351994 1346 webserver.cc:460] Webserver started at http://127.14.175.195:37371/ using document root <none> and password file <none>
I20260809 02:01:31.352481 1346 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:31.352550 1346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:31.352708 1346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:31.354656 1346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "a2da6b040cb341d7908345b105869e94"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "63e001ecb83a1856fe1464262dc8ba87"
server_key_iv: "9efdb578aca4a81b4dc45f30df731864"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.355245 1346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "a2da6b040cb341d7908345b105869e94"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "63e001ecb83a1856fe1464262dc8ba87"
server_key_iv: "9efdb578aca4a81b4dc45f30df731864"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.358788 1346 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:01:31.361186 1363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.362346 1346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:31.362445 1346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "a2da6b040cb341d7908345b105869e94"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "63e001ecb83a1856fe1464262dc8ba87"
server_key_iv: "9efdb578aca4a81b4dc45f30df731864"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.362526 1346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:31.377741 1346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:31.380458 1346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:31.380602 1346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:31.381076 1346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:31.381848 1346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:31.381894 1346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.381961 1346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:31.381996 1346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.390699 1346 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:45087
I20260809 02:01:31.390731 1482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:45087 every 8 connection(s)
I20260809 02:01:31.391614 1346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:01:31 dist-test-slave-2w3w krb5kdc[942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:31.401674 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1346
I20260809 02:01:31.401852 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:31.402245 15039 external_mini_cluster.cc:1428] Setting key 49ca2bc69210327cd43e4e0c07e290ad
I20260809 02:01:31.405290 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.393373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:45621 (local address 127.14.175.254:37553)
0809 02:01:31.393515 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.393519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.394270 (+ 751us) server_negotiation.cc:407] Connection header received
0809 02:01:31.395723 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.395726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.395786 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.395898 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:31.397030 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.397571 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.398712 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.398938 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.399122 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.401507 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:31.401511 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:31.401514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:31.401545 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:31.403286 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.403807 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.403811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.403813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.403907 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.404296 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.404298 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.404300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.404545 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:31.404626 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.405082 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.405176 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:01:31.406080 1486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.393699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37553 (local address 127.14.175.195:45621)
0809 02:01:31.394126 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.394167 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.395516 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.396072 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.396078 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.396413 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:31.396875 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.396887 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.397698 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.397709 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.398582 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.398591 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.399176 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.399180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.399354 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.399871 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:31.399886 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:31.401314 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:31.403408 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:31.403414 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:31.403428 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:31.403697 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:31.404018 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:31.404022 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:31.404024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:31.404167 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:31.404648 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:31.404653 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:31.404875 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.405036 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.405277 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":108,"threads_started":1}
I20260809 02:01:31.407199 1483 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37553
I20260809 02:01:31.407393 1483 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:31.407814 1483 heartbeater.cc:511] Master 127.14.175.254:37553 requested a full tablet report, sending...
I20260809 02:01:31.408732 991 ts_manager.cc:194] Registered new tserver with Master: a2da6b040cb341d7908345b105869e94 (127.14.175.195:45087)
I20260809 02:01:31.409288 991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:45621
I20260809 02:01:31.416097 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:31.425354 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.418002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36386 (local address 127.14.175.254:37553)
0809 02:01:31.418121 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.418126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.418321 (+ 195us) server_negotiation.cc:407] Connection header received
0809 02:01:31.418474 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.418477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.418520 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.418602 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:31.419365 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.419868 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.420687 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.420914 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.421040 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.422297 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:31.422300 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:31.422303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:31.422328 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:31.423565 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.424005 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.424010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.424013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.424124 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:31.424406 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:31.424410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:31.424411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:31.424692 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:31.424831 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.425071 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.425181 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:01:31.427963 991 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:31.430805 991 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:31.444964 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.439647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52240 (local address 127.14.175.194:38927)
0809 02:01:31.440137 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.440149 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.440168 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:01:31.440232 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.440236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.440605 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.440742 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:31.441004 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.441731 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.443369 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444219 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.444356 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.444492 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.444739 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.444834 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":149,"threads_started":1}
I20260809 02:01:31.445051 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.438589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43319 (local address 127.0.0.1:44318)
0809 02:01:31.439086 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.439142 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.439267 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.440249 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.440254 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.440276 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:31.440434 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.440443 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.442138 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.442144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.443542 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.443553 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444598 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.444602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.444692 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.444714 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.444802 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.444858 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":85,"threads_started":1}
I20260809 02:01:31.445182 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.438741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44318 (local address 127.14.175.193:43319)
0809 02:01:31.439243 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.439255 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.439280 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:01:31.439831 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.439840 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.440050 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.440606 (+ 556us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:31.440747 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.441945 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.443687 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444478 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.444611 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.444730 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.444924 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.445043 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":150,"threads_started":1}
I20260809 02:01:31.444918 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.438659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45087 (local address 127.0.0.1:42030)
0809 02:01:31.439570 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.439584 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.439669 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.440683 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.440685 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.440702 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:31.440807 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.440813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.442216 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.442219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.443401 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.443409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444442 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.444445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.444527 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.444543 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.444628 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.444765 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260809 02:01:31.445600 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.439337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38927 (local address 127.0.0.1:52240)
0809 02:01:31.439659 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.439672 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.439764 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.440739 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.440742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.440759 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:31.440880 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.440887 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.441865 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.441869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.443243 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.443254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444363 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.444370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.444495 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.444542 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.444646 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.444844 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":89,"thread_start_us":99,"threads_started":1}
I20260809 02:01:31.446417 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.439412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.14.175.195:45087)
0809 02:01:31.440122 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.440135 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.440158 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:01:31.440231 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.440236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.440420 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.440580 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:31.440946 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.442065 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.443521 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.444309 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.445042 (+ 733us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.445217 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.445318 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.446218 (+ 900us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":173,"threads_started":1}
I20260809 02:01:31.448741 1126 tablet_service.cc:1467] Processing CreateTablet for tablet 260e069ed66043ad91449703be44dde5 (DEFAULT_TABLE table=test-table [id=a5b9a97874ef4a9ea955508c82caa721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:31.448678 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 260e069ed66043ad91449703be44dde5 (DEFAULT_TABLE table=test-table [id=a5b9a97874ef4a9ea955508c82caa721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:31.449244 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 260e069ed66043ad91449703be44dde5 (DEFAULT_TABLE table=test-table [id=a5b9a97874ef4a9ea955508c82caa721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:31.449700 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260e069ed66043ad91449703be44dde5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:31.449704 1126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260e069ed66043ad91449703be44dde5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:31.450102 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260e069ed66043ad91449703be44dde5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:31.456534 1501 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Bootstrap starting.
I20260809 02:01:31.457347 1503 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Bootstrap starting.
I20260809 02:01:31.458482 1501 tablet_bootstrap.cc:654] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:31.459101 1503 tablet_bootstrap.cc:654] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:31.459307 1502 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Bootstrap starting.
I20260809 02:01:31.459782 1501 log.cc:824] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:31.460342 1503 log.cc:824] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:31.461385 1502 tablet_bootstrap.cc:654] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:31.461845 1501 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: No bootstrap required, opened a new log
I20260809 02:01:31.462042 1501 ts_tablet_manager.cc:1397] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 02:01:31.462409 1503 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: No bootstrap required, opened a new log
I20260809 02:01:31.462509 1502 log.cc:824] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:31.462584 1503 ts_tablet_manager.cc:1397] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 02:01:31.464015 1502 tablet_bootstrap.cc:492] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: No bootstrap required, opened a new log
I20260809 02:01:31.464201 1502 ts_tablet_manager.cc:1397] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:01:31.466043 1501 raft_consensus.cc:348] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.466321 1501 raft_consensus.cc:374] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:31.466380 1501 raft_consensus.cc:729] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b626cbee24e249fd8cbb142c79a47b7e, State: Initialized, Role: FOLLOWER
I20260809 02:01:31.466315 1503 raft_consensus.cc:348] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.466562 1503 raft_consensus.cc:374] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:31.466648 1503 raft_consensus.cc:729] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2da6b040cb341d7908345b105869e94, State: Initialized, Role: FOLLOWER
I20260809 02:01:31.466905 1501 consensus_queue.cc:260] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.467047 1503 consensus_queue.cc:260] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.467538 1502 raft_consensus.cc:348] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.467774 1502 raft_consensus.cc:374] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:31.467824 1502 raft_consensus.cc:729] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfa13bbc01dd498f93fd4ac2c898eb10, State: Initialized, Role: FOLLOWER
I20260809 02:01:31.467988 1501 ts_tablet_manager.cc:1428] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260809 02:01:31.468099 1198 tablet.cc:2369] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:31.468251 1502 consensus_queue.cc:260] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.468346 1197 heartbeater.cc:503] Master 127.14.175.254:37553 was elected leader, sending a full tablet report...
I20260809 02:01:31.468650 1503 ts_tablet_manager.cc:1428] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:01:31.468945 1483 heartbeater.cc:503] Master 127.14.175.254:37553 was elected leader, sending a full tablet report...
I20260809 02:01:31.469142 1502 ts_tablet_manager.cc:1428] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:01:31.469449 1341 heartbeater.cc:503] Master 127.14.175.254:37553 was elected leader, sending a full tablet report...
W20260809 02:01:31.642637 1484 tablet.cc:2369] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:01:31.681757 1342 tablet.cc:2369] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:31.707662 1508 raft_consensus.cc:482] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:31.707885 1508 raft_consensus.cc:504] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.709167 1508 leader_election.cc:288] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b626cbee24e249fd8cbb142c79a47b7e (127.14.175.193:43319), dfa13bbc01dd498f93fd4ac2c898eb10 (127.14.175.194:38927)
I20260809 02:01:31.713014 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.709680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:51769 (local address 127.14.175.193:43319)
0809 02:01:31.709955 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.709967 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.709980 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:01:31.710025 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.710027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.710069 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.710158 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:31.710439 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.711043 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712046 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.712453 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712580 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.712635 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.712825 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.712895 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260809 02:01:31.713014 1486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.709477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43319 (local address 127.14.175.195:51769)
0809 02:01:31.709688 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.709706 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.709811 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.710169 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.710172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.710189 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:31.710322 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.710328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.711146 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.711152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.711913 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.711922 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.712580 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.712698 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.712716 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.712806 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.712885 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 02:01:31.713275 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.709601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:43499 (local address 127.14.175.194:38927)
0809 02:01:31.709835 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.709839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.710219 (+ 380us) server_negotiation.cc:407] Connection header received
0809 02:01:31.710390 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.710397 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.710440 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.710535 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:31.710809 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.711299 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712290 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.712696 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712823 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.712872 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.713062 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.713155 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260809 02:01:31.713557 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.709477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:38927 (local address 127.14.175.195:43499)
0809 02:01:31.710085 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.710103 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:31.710256 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:31.710544 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:31.710547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:31.710563 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:31.710691 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.710696 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.711417 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.711420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.712166 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:31.712174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.712824 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.712827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:31.712934 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.712952 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:01:31.713045 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 02:01:31.713411 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"mutex_wait_us":179,"thread_start_us":111,"threads_started":1}
I20260809 02:01:31.713814 1150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260e069ed66043ad91449703be44dde5" candidate_uuid: "a2da6b040cb341d7908345b105869e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b626cbee24e249fd8cbb142c79a47b7e" is_pre_election: true
I20260809 02:01:31.714128 1150 raft_consensus.cc:2454] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2da6b040cb341d7908345b105869e94 in term 0.
I20260809 02:01:31.714190 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260e069ed66043ad91449703be44dde5" candidate_uuid: "a2da6b040cb341d7908345b105869e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" is_pre_election: true
I20260809 02:01:31.714475 1292 raft_consensus.cc:2454] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2da6b040cb341d7908345b105869e94 in term 0.
I20260809 02:01:31.714641 1365 leader_election.cc:302] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2da6b040cb341d7908345b105869e94, b626cbee24e249fd8cbb142c79a47b7e; no voters:
I20260809 02:01:31.714928 1508 raft_consensus.cc:2781] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:31.715066 1508 raft_consensus.cc:482] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:31.715126 1508 raft_consensus.cc:3037] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:31.716248 1508 raft_consensus.cc:504] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.716632 1508 leader_election.cc:288] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [CANDIDATE]: Term 1 election: Requested vote from peers b626cbee24e249fd8cbb142c79a47b7e (127.14.175.193:43319), dfa13bbc01dd498f93fd4ac2c898eb10 (127.14.175.194:38927)
I20260809 02:01:31.717031 1150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260e069ed66043ad91449703be44dde5" candidate_uuid: "a2da6b040cb341d7908345b105869e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b626cbee24e249fd8cbb142c79a47b7e"
I20260809 02:01:31.717188 1150 raft_consensus.cc:3037] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:31.717206 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260e069ed66043ad91449703be44dde5" candidate_uuid: "a2da6b040cb341d7908345b105869e94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10"
I20260809 02:01:31.717317 1292 raft_consensus.cc:3037] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:31.718314 1150 raft_consensus.cc:2454] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2da6b040cb341d7908345b105869e94 in term 1.
I20260809 02:01:31.718483 1292 raft_consensus.cc:2454] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2da6b040cb341d7908345b105869e94 in term 1.
I20260809 02:01:31.718649 1365 leader_election.cc:302] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2da6b040cb341d7908345b105869e94, b626cbee24e249fd8cbb142c79a47b7e; no voters:
I20260809 02:01:31.718844 1508 raft_consensus.cc:2781] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:31.719151 1508 raft_consensus.cc:686] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 1 LEADER]: Becoming Leader. State: Replica: a2da6b040cb341d7908345b105869e94, State: Running, Role: LEADER
I20260809 02:01:31.719485 1508 consensus_queue.cc:237] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } }
I20260809 02:01:31.722576 990 catalog_manager.cc:5495] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2da6b040cb341d7908345b105869e94 (127.14.175.195). New cstate: current_term: 1 leader_uuid: "a2da6b040cb341d7908345b105869e94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2da6b040cb341d7908345b105869e94" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 } health_report { overall_health: UNKNOWN } } }
I20260809 02:01:31.735715 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.732055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42038 (local address 127.14.175.195:45087)
0809 02:01:31.732199 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:31.732204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:31.732217 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:01:31.732380 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:31.732383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:31.732445 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:31.732563 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:31.732800 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.733313 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.734184 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:31.734421 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:31.734529 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:31.734859 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:31.735303 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:31.735434 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:31.735497 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:01:31.735556 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:01:31.741420 1292 raft_consensus.cc:1261] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 1 FOLLOWER]: Refusing update from remote peer a2da6b040cb341d7908345b105869e94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:31.741420 1150 raft_consensus.cc:1261] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 1 FOLLOWER]: Refusing update from remote peer a2da6b040cb341d7908345b105869e94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:31.742141 1511 consensus_queue.cc:1035] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b626cbee24e249fd8cbb142c79a47b7e" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:31.742322 1508 consensus_queue.cc:1035] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfa13bbc01dd498f93fd4ac2c898eb10" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 38927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:31.752249 1515 mvcc.cc:205] Tried to move back new op lower bound from 7316442692565082112 to 7316442692485627904. Current Snapshot: MvccSnapshot[applied={T|T < 7316442692565082112}]
I20260809 02:01:31.757200 989 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:31.757378 989 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:31.759805 989 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 94f23f6cb6b74efd95b171fdf6b33b07: Sending DeleteTablet for 3 replicas of tablet 260e069ed66043ad91449703be44dde5
I20260809 02:01:31.760591 1126 tablet_service.cc:1514] Processing DeleteTablet for tablet 260e069ed66043ad91449703be44dde5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:44318
I20260809 02:01:31.760795 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 260e069ed66043ad91449703be44dde5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:52240
I20260809 02:01:31.761085 1524 tablet_replica.cc:330] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e: stopping tablet replica
I20260809 02:01:31.761075 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 260e069ed66043ad91449703be44dde5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:31 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:42030
I20260809 02:01:31.761374 1524 raft_consensus.cc:2229] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:31.761595 1525 tablet_replica.cc:330] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: stopping tablet replica
I20260809 02:01:31.761682 1524 raft_consensus.cc:2258] T 260e069ed66043ad91449703be44dde5 P b626cbee24e249fd8cbb142c79a47b7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:31.761840 1525 raft_consensus.cc:2229] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:31.762108 1525 raft_consensus.cc:2258] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:31.762120 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1057
I20260809 02:01:31.763540 1525 ts_tablet_manager.cc:1905] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:31.766248 1525 ts_tablet_manager.cc:1918] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:31.766366 1525 log.cc:1196] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/260e069ed66043ad91449703be44dde5
I20260809 02:01:31.766710 1525 ts_tablet_manager.cc:1939] T 260e069ed66043ad91449703be44dde5 P dfa13bbc01dd498f93fd4ac2c898eb10: Deleting consensus metadata
I20260809 02:01:31.767963 1526 tablet_replica.cc:330] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: stopping tablet replica
I20260809 02:01:31.767930 977 catalog_manager.cc:4841] TS dfa13bbc01dd498f93fd4ac2c898eb10 (127.14.175.194:38927): tablet 260e069ed66043ad91449703be44dde5 (table test-table [id=a5b9a97874ef4a9ea955508c82caa721]) successfully deleted
I20260809 02:01:31.768222 1526 raft_consensus.cc:2229] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:31.768630 1526 raft_consensus.cc:2258] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:31.769799 1526 ts_tablet_manager.cc:1905] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:01:31.771878 975 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:43319 (error 108)
I20260809 02:01:31.771979 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1202
I20260809 02:01:31.772111 1526 ts_tablet_manager.cc:1918] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:31.774544 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:31.774238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43319 (local address 127.0.0.1:44320)
0809 02:01:31.774382 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:31.774455 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 02:01:31.774714 975 catalog_manager.cc:4584] TS b626cbee24e249fd8cbb142c79a47b7e (127.14.175.193:43319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 260e069ed66043ad91449703be44dde5: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43319: connect: Connection refused (error 111)
I20260809 02:01:31.775043 1526 log.cc:1196] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/260e069ed66043ad91449703be44dde5
I20260809 02:01:31.775418 1526 ts_tablet_manager.cc:1939] T 260e069ed66043ad91449703be44dde5 P a2da6b040cb341d7908345b105869e94: Deleting consensus metadata
I20260809 02:01:31.776495 974 catalog_manager.cc:4841] TS a2da6b040cb341d7908345b105869e94 (127.14.175.195:45087): tablet 260e069ed66043ad91449703be44dde5 (table test-table [id=a5b9a97874ef4a9ea955508c82caa721]) successfully deleted
I20260809 02:01:31.779131 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1346
I20260809 02:01:31.784955 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 956
2026-08-09T02:01:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2482 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T02:01:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:31Z Disabled control of system clock
I20260809 02:01:31.820014 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:38077
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:38077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:31.928565 1531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:31.928825 1531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:31.928898 1531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:31.932911 1531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:31.932966 1531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:31.932981 1531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:31.932998 1531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:31.933013 1531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:31.937664 1531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:38077
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:38077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:31.938642 1531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:31.939946 1531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:31.948346 1537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:31.948411 1531 server_base.cc:1034] running on GCE node
W20260809 02:01:31.948360 1539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:31.948364 1536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:31.949080 1531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:31.950088 1531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:31.951272 1531 hybrid_clock.cc:648] HybridClock initialized: now 1786240891951255 us; error 30 us; skew 500 ppm
I20260809 02:01:31.952991 1531 webserver.cc:460] Webserver started at http://127.14.175.254:40395/ using document root <none> and password file <none>
I20260809 02:01:31.953558 1531 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:31.953649 1531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:31.953876 1531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:31.955914 1531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "2df0d02535674dab957e839cdcf0644e"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "85d7e2ae00519378438d1949fd463383"
server_key_iv: "8fbfdf83dd6f30d4679a38dde82ca05b"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.956466 1531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "2df0d02535674dab957e839cdcf0644e"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "85d7e2ae00519378438d1949fd463383"
server_key_iv: "8fbfdf83dd6f30d4679a38dde82ca05b"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.959903 1531 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:01:31.962056 1545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:31.963282 1531 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:31.963434 1531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "2df0d02535674dab957e839cdcf0644e"
format_stamp: "Formatted at 2026-08-09 02:01:31 on dist-test-slave-2w3w"
server_key: "85d7e2ae00519378438d1949fd463383"
server_key_iv: "8fbfdf83dd6f30d4679a38dde82ca05b"
server_key_version: "encryptionkey@0"
I20260809 02:01:31.963543 1531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:31.987175 1531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:31.987864 1531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:31.988070 1531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:31.994825 1531 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:38077
I20260809 02:01:31.994833 1600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:38077 every 8 connection(s)
I20260809 02:01:31.995782 1531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:31.999320 1601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:32.004858 1601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: Bootstrap starting.
I20260809 02:01:32.005985 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1531
I20260809 02:01:32.006151 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:32.006453 15039 external_mini_cluster.cc:1428] Setting key affdc8842a7bb95269a73363d76c19a9
I20260809 02:01:32.007658 1601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:32.008469 1601 log.cc:824] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:32.010449 1601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: No bootstrap required, opened a new log
I20260809 02:01:32.013908 1601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } }
I20260809 02:01:32.014115 1601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:32.014175 1601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df0d02535674dab957e839cdcf0644e, State: Initialized, Role: FOLLOWER
I20260809 02:01:32.014674 1601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } }
I20260809 02:01:32.014890 1601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:32.014981 1601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:32.015089 1601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:32.015661 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.007637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36510 (local address 127.14.175.254:38077)
0809 02:01:32.008264 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.008278 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.008311 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:01:32.009053 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.009079 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.009465 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.009803 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:32.010229 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.011301 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.012205 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.012684 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.012862 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.013718 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:32.013723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:32.013735 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:32.014138 (+ 403us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:32.014210 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:32.014251 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:32.014379 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.014514 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.014785 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":136,"threads_started":1}
I20260809 02:01:32.016093 1601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } }
I20260809 02:01:32.016434 1601 leader_election.cc:302] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2df0d02535674dab957e839cdcf0644e; no voters:
I20260809 02:01:32.016750 1601 leader_election.cc:288] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:32.016827 1607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:32.017079 1607 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [term 1 LEADER]: Becoming Leader. State: Replica: 2df0d02535674dab957e839cdcf0644e, State: Running, Role: LEADER
I20260809 02:01:32.017395 1607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } }
I20260809 02:01:32.017958 1601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:32.018541 1608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2df0d02535674dab957e839cdcf0644e. Latest consensus state: current_term: 1 leader_uuid: "2df0d02535674dab957e839cdcf0644e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } } }
I20260809 02:01:32.018671 1608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:32.018981 1609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2df0d02535674dab957e839cdcf0644e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df0d02535674dab957e839cdcf0644e" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 38077 } } }
I20260809 02:01:32.019075 1609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:32.019330 1613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:32.022264 1613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:32.027839 1613 catalog_manager.cc:1347] Generated new cluster ID: 4cc5632a0eac48e590b590b31db8fd24
I20260809 02:01:32.027900 1613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:32.044209 1613 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:32.045161 1613 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:32.053061 1613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: Generated new TSK 0
I20260809 02:01:32.053691 1613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:32.057255 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--builtin_ntp_servers=127.14.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:32.166550 1628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:32.166775 1628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:32.166811 1628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:32.170840 1628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:32.170895 1628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:32.170993 1628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:32.175657 1628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:32.176621 1628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:32.177891 1628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:32.187155 1633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:32.187175 1628 server_base.cc:1034] running on GCE node
W20260809 02:01:32.187194 1636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:32.187162 1634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:32.187784 1628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:32.188413 1628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:32.189596 1628 hybrid_clock.cc:648] HybridClock initialized: now 1786240892189587 us; error 29 us; skew 500 ppm
I20260809 02:01:32.191457 1628 webserver.cc:460] Webserver started at http://127.14.175.193:43625/ using document root <none> and password file <none>
I20260809 02:01:32.192001 1628 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:32.192091 1628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:32.192314 1628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:32.194365 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "b8c3f04b36934c43a8d202ee8d96efdd"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "92b5bddc4fcbbb539a8e52291b9ec950"
server_key_iv: "de44e31a4616db62fbd076568ab46f6a"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.194923 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "b8c3f04b36934c43a8d202ee8d96efdd"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "92b5bddc4fcbbb539a8e52291b9ec950"
server_key_iv: "de44e31a4616db62fbd076568ab46f6a"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.198333 1628 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:01:32.200697 1642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.201872 1628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:01:32.202000 1628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "b8c3f04b36934c43a8d202ee8d96efdd"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "92b5bddc4fcbbb539a8e52291b9ec950"
server_key_iv: "de44e31a4616db62fbd076568ab46f6a"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.202103 1628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:32.217947 1628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:32.218554 1628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:32.218750 1628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:32.219336 1628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:32.220270 1628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:32.220336 1628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.220410 1628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:32.220461 1628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.229255 1628 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:46383
I20260809 02:01:32.229300 1760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:46383 every 8 connection(s)
I20260809 02:01:32.230103 1628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:32.234045 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1628
I20260809 02:01:32.234182 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:32.234476 15039 external_mini_cluster.cc:1428] Setting key b89f97f665e19179b0a4780331b4e37a
I20260809 02:01:32.236439 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--builtin_ntp_servers=127.14.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:32.240134 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.231879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:48939 (local address 127.14.175.254:38077)
0809 02:01:32.232009 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.232014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.232998 (+ 984us) server_negotiation.cc:407] Connection header received
0809 02:01:32.234434 (+ 1436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.234438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.234496 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.234585 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:32.235663 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.236289 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.238007 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.238236 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.238351 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.239523 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:32.239529 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:32.239535 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:32.239554 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:32.239582 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:32.239596 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:32.239681 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.239856 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.239927 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:01:32.240832 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.232246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38077 (local address 127.14.175.193:48939)
0809 02:01:32.232858 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.232896 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.234198 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.234839 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.234845 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.234922 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:32.235520 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.235534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.236439 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.236442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.237879 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.237894 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.238404 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.238409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.238577 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.239202 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:32.239203 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:32.239239 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:32.239327 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:32.239697 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:32.239706 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:32.239712 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.239836 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.240084 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":116,"threads_started":1}
I20260809 02:01:32.241961 1761 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38077
I20260809 02:01:32.242177 1761 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:32.242630 1761 heartbeater.cc:511] Master 127.14.175.254:38077 requested a full tablet report, sending...
I20260809 02:01:32.244017 1562 ts_manager.cc:194] Registered new tserver with Master: b8c3f04b36934c43a8d202ee8d96efdd (127.14.175.193:46383)
I20260809 02:01:32.245085 1562 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.193:48939
W20260809 02:01:32.346385 1764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:32.346599 1764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:32.346634 1764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:32.350595 1764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:32.350644 1764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:32.350735 1764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:32.355450 1764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:32.356356 1764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:32.357622 1764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:32.367563 1769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:32.367523 1770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:32.367523 1772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:32.367619 1764 server_base.cc:1034] running on GCE node
I20260809 02:01:32.368129 1764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:32.368714 1764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:32.369874 1764 hybrid_clock.cc:648] HybridClock initialized: now 1786240892369846 us; error 41 us; skew 500 ppm
I20260809 02:01:32.371639 1764 webserver.cc:460] Webserver started at http://127.14.175.194:44141/ using document root <none> and password file <none>
I20260809 02:01:32.372179 1764 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:32.372241 1764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:32.372452 1764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:32.374403 1764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "f5b54d9f49cc4f23a66064c97d0eea7b"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "554bd28d373de88d727bd5d08ce41431"
server_key_iv: "884e7a221f2e79eb1ef5fc106abad4d3"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.374996 1764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "f5b54d9f49cc4f23a66064c97d0eea7b"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "554bd28d373de88d727bd5d08ce41431"
server_key_iv: "884e7a221f2e79eb1ef5fc106abad4d3"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.378453 1764 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:01:32.381050 1779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.382216 1764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:32.382380 1764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "f5b54d9f49cc4f23a66064c97d0eea7b"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "554bd28d373de88d727bd5d08ce41431"
server_key_iv: "884e7a221f2e79eb1ef5fc106abad4d3"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.382494 1764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:32.392277 1764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:32.392866 1764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:32.393062 1764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:32.393662 1764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:32.394557 1764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:32.394629 1764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.394695 1764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:32.394744 1764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.404249 1764 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:35063
I20260809 02:01:32.404309 1895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:35063 every 8 connection(s)
I20260809 02:01:32.405190 1764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:32.413992 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1764
I20260809 02:01:32.414134 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:32.414299 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.407081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:43003 (local address 127.14.175.254:38077)
0809 02:01:32.407234 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.407239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.408258 (+ 1019us) server_negotiation.cc:407] Connection header received
0809 02:01:32.409687 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.409689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.409736 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.409815 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:32.410662 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.411226 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.412397 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.412607 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.412689 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.413772 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:32.413777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:32.413781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:32.413796 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:32.413830 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:32.413841 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:32.413926 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.414073 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.414141 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:01:32.414523 15039 external_mini_cluster.cc:1428] Setting key 7f61f8a71d17c2a75851fffaa6ce3e1b
I20260809 02:01:32.415328 1898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.407482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38077 (local address 127.14.175.194:43003)
0809 02:01:32.408108 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.408148 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.409489 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.409972 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.409978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.410055 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:32.410530 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.410542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.411357 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.411360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.412270 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.412279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.412739 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.412742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.412883 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.413521 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:32.413522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:32.413560 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:32.413618 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:32.413934 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:32.413941 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:32.413945 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.414038 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.414333 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":115,"threads_started":1}
I20260809 02:01:32.416579 1896 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38077
I20260809 02:01:32.416786 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--builtin_ntp_servers=127.14.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:32.416816 1896 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:32.417331 1896 heartbeater.cc:511] Master 127.14.175.254:38077 requested a full tablet report, sending...
I20260809 02:01:32.418413 1562 ts_manager.cc:194] Registered new tserver with Master: f5b54d9f49cc4f23a66064c97d0eea7b (127.14.175.194:35063)
I20260809 02:01:32.419193 1562 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.194:43003
W20260809 02:01:32.529458 1899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:32.529745 1899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:32.529815 1899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:32.533898 1899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:32.533979 1899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:32.534062 1899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:32.538815 1899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:38077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:32.539826 1899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:32.541145 1899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:32.550446 1907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:32.550400 1906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:32.550416 1909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:32.550638 1899 server_base.cc:1034] running on GCE node
I20260809 02:01:32.551241 1899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:32.551847 1899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:32.553042 1899 hybrid_clock.cc:648] HybridClock initialized: now 1786240892553017 us; error 48 us; skew 500 ppm
I20260809 02:01:32.554884 1899 webserver.cc:460] Webserver started at http://127.14.175.195:40443/ using document root <none> and password file <none>
I20260809 02:01:32.555459 1899 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:32.555563 1899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:32.555797 1899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:32.557770 1899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "1c437fcf3e294246a90053dea99b57cc"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "43c014f525515b95e05a85ccf0a9a0b3"
server_key_iv: "2719803a0a9ef6e5735d6dc81d941eb9"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.558331 1899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "1c437fcf3e294246a90053dea99b57cc"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "43c014f525515b95e05a85ccf0a9a0b3"
server_key_iv: "2719803a0a9ef6e5735d6dc81d941eb9"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.561894 1899 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:01:32.564307 1915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.565412 1899 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:32.565559 1899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1c437fcf3e294246a90053dea99b57cc"
format_stamp: "Formatted at 2026-08-09 02:01:32 on dist-test-slave-2w3w"
server_key: "43c014f525515b95e05a85ccf0a9a0b3"
server_key_iv: "2719803a0a9ef6e5735d6dc81d941eb9"
server_key_version: "encryptionkey@0"
I20260809 02:01:32.565668 1899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:32.584837 1899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:32.585593 1899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:32.585788 1899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:32.586408 1899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:32.587427 1899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:32.587502 1899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.587580 1899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:32.587631 1899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:32.596886 1899 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:34601
I20260809 02:01:32.596926 2035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:34601 every 8 connection(s)
I20260809 02:01:32.597798 1899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:32.604385 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 1899
I20260809 02:01:32.604512 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:32.604841 15039 external_mini_cluster.cc:1428] Setting key 69ea3edf0f7b71bfca70afe6da838a99
I20260809 02:01:32.607589 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.599686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:43713 (local address 127.14.175.254:38077)
0809 02:01:32.599832 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.599837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.600870 (+ 1033us) server_negotiation.cc:407] Connection header received
0809 02:01:32.602279 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.602282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.602357 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.602464 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:32.603388 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.603920 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.605410 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.605701 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.605830 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.607140 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:32.607143 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:32.607145 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:32.607174 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:32.607197 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:32.607207 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:32.607285 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.607425 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.607474 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:01:32.608495 2038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.600074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:38077 (local address 127.14.175.195:43713)
0809 02:01:32.600694 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.600734 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.602070 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.602628 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.602636 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.602715 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:32.603244 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.603257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.604050 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.604059 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.605226 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.605239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.605921 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.605927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.606110 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.606845 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:32.606847 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:32.606897 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:32.606996 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:32.607299 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:32.607306 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:32.607311 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.607409 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.607612 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":99,"threads_started":1}
I20260809 02:01:32.609536 2036 heartbeater.cc:347] Connected to a master server at 127.14.175.254:38077
I20260809 02:01:32.609754 2036 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:32.610262 2036 heartbeater.cc:511] Master 127.14.175.254:38077 requested a full tablet report, sending...
I20260809 02:01:32.611277 1562 ts_manager.cc:194] Registered new tserver with Master: 1c437fcf3e294246a90053dea99b57cc (127.14.175.195:34601)
I20260809 02:01:32.611830 1562 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.195:43713
I20260809 02:01:32.618885 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:32.624379 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.620906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.14.175.254:38077)
0809 02:01:32.621056 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.621059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.621217 (+ 158us) server_negotiation.cc:407] Connection header received
0809 02:01:32.621311 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.621313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.621348 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.621413 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:32.621630 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.622110 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.622954 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.623212 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.623292 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.624059 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:32.624062 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:32.624063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:32.624074 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:32.624092 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:32.624100 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:32.624157 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.624234 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.624279 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:01:32.626928 1562 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:32.629964 1562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:32.643965 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.638203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.14.175.194:35063)
0809 02:01:32.638691 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.638703 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.638730 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:01:32.638808 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.638813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.639046 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.639211 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:32.639727 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.640884 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.642486 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.643287 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.643422 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.643599 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.643702 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.643798 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":155,"threads_started":1}
I20260809 02:01:32.643956 2048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.638035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:35063 (local address 127.0.0.1:58038)
0809 02:01:32.638486 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.638540 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.638670 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.639411 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.639418 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.639441 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:32.639583 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.639591 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.641010 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.641013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.642337 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.642347 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.643413 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.643416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.643520 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.643556 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.643675 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.643794 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":81,"threads_started":1}
I20260809 02:01:32.644356 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.638835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.14.175.195:34601)
0809 02:01:32.639219 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.639231 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.639469 (+ 238us) server_negotiation.cc:407] Connection header received
0809 02:01:32.639567 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.639574 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.639783 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.639938 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:32.640308 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.641264 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.642503 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.643305 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.643432 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.643593 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.644084 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.644182 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":194,"threads_started":1}
I20260809 02:01:32.644465 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.638130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:34601 (local address 127.0.0.1:57752)
0809 02:01:32.639341 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.639357 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.639458 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.640096 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.640099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.640124 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:32.640190 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.640194 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.641390 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.641394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.642367 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.642378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.643659 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.643663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.643750 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.643773 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.643863 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.643939 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1142,"mutex_wait_us":1,"spinlock_wait_cycles":2432,"thread_start_us":91,"threads_started":1}
I20260809 02:01:32.644487 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.638763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46383 (local address 127.0.0.1:33450)
0809 02:01:32.639629 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.639644 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.639718 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.640382 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.640385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.640402 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:32.640486 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.640492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.641644 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.641648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.643019 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.643030 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.644104 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.644108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.644187 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.644209 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.644259 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.644334 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":88,"threads_started":1}
I20260809 02:01:32.645121 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.639285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33450 (local address 127.14.175.193:46383)
0809 02:01:32.639987 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.640003 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.640026 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:01:32.640099 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.640104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.640262 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.640408 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:32.640615 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.641521 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.643164 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.643947 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.644632 (+ 685us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.644798 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.644855 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.644955 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":130,"threads_started":1}
I20260809 02:01:32.647526 1827 tablet_service.cc:1467] Processing CreateTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd (DEFAULT_TABLE table=test-table [id=cb58266498f04ceda9b6858c4da44260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:32.647609 1693 tablet_service.cc:1467] Processing CreateTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd (DEFAULT_TABLE table=test-table [id=cb58266498f04ceda9b6858c4da44260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:32.647571 1968 tablet_service.cc:1467] Processing CreateTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd (DEFAULT_TABLE table=test-table [id=cb58266498f04ceda9b6858c4da44260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:32.648504 1827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ad9c72d01b4663bc913039bdbde6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:32.648582 1968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ad9c72d01b4663bc913039bdbde6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:32.648582 1693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ad9c72d01b4663bc913039bdbde6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:32.655311 2056 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Bootstrap starting.
I20260809 02:01:32.656373 2058 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Bootstrap starting.
I20260809 02:01:32.657212 2056 tablet_bootstrap.cc:654] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:32.657924 2056 log.cc:824] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:32.658059 2058 tablet_bootstrap.cc:654] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:32.658721 2058 log.cc:824] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:32.659281 2057 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: Bootstrap starting.
I20260809 02:01:32.659878 2056 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: No bootstrap required, opened a new log
I20260809 02:01:32.660259 2056 ts_tablet_manager.cc:1397] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:01:32.660636 2058 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: No bootstrap required, opened a new log
I20260809 02:01:32.660804 2058 ts_tablet_manager.cc:1397] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:01:32.661348 2057 tablet_bootstrap.cc:654] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:32.662142 2057 log.cc:824] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:32.664099 2057 tablet_bootstrap.cc:492] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: No bootstrap required, opened a new log
I20260809 02:01:32.664294 2057 ts_tablet_manager.cc:1397] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:01:32.664258 2056 raft_consensus.cc:348] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.664569 2056 raft_consensus.cc:374] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:32.664636 2056 raft_consensus.cc:729] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5b54d9f49cc4f23a66064c97d0eea7b, State: Initialized, Role: FOLLOWER
I20260809 02:01:32.665068 2056 consensus_queue.cc:260] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.664961 2058 raft_consensus.cc:348] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.665205 2058 raft_consensus.cc:374] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:32.665272 2058 raft_consensus.cc:729] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c437fcf3e294246a90053dea99b57cc, State: Initialized, Role: FOLLOWER
I20260809 02:01:32.665675 1896 heartbeater.cc:503] Master 127.14.175.254:38077 was elected leader, sending a full tablet report...
I20260809 02:01:32.665719 2058 consensus_queue.cc:260] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.666029 2056 ts_tablet_manager.cc:1428] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:01:32.666675 2036 heartbeater.cc:503] Master 127.14.175.254:38077 was elected leader, sending a full tablet report...
I20260809 02:01:32.666714 2058 ts_tablet_manager.cc:1428] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:01:32.668361 2057 raft_consensus.cc:348] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.668613 2057 raft_consensus.cc:374] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:32.668676 2057 raft_consensus.cc:729] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c3f04b36934c43a8d202ee8d96efdd, State: Initialized, Role: FOLLOWER
I20260809 02:01:32.669085 2057 consensus_queue.cc:260] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.669785 1761 heartbeater.cc:503] Master 127.14.175.254:38077 was elected leader, sending a full tablet report...
I20260809 02:01:32.670127 2057 ts_tablet_manager.cc:1428] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260809 02:01:32.681313 2062 raft_consensus.cc:482] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:32.681478 2062 raft_consensus.cc:504] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.682490 2062 leader_election.cc:288] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c437fcf3e294246a90053dea99b57cc (127.14.175.195:34601), b8c3f04b36934c43a8d202ee8d96efdd (127.14.175.193:46383)
I20260809 02:01:32.686347 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.682817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:34635 (local address 127.14.175.195:34601)
0809 02:01:32.682923 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.682927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.682943 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:01:32.683053 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.683056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.683102 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.683188 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:32.683541 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.684160 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.685401 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.685791 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.685927 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.685973 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.686164 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.686227 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:01:32.686364 1898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.682685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:34601 (local address 127.14.175.194:34635)
0809 02:01:32.682818 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.682836 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.682924 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.683207 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.683209 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.683225 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:32.683408 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.683416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.684267 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.684270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.685247 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.685257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.685922 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.685925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.686037 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.686056 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.686147 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.686222 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":55,"spinlock_wait_cycles":16000}
I20260809 02:01:32.686458 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.682814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:33803 (local address 127.14.175.193:46383)
0809 02:01:32.682923 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.682939 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.683275 (+ 336us) server_negotiation.cc:407] Connection header received
0809 02:01:32.683421 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.683424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.683481 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.683558 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:32.683822 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.684348 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.685405 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.685887 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.686006 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.686051 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.686245 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.686319 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:01:32.686821 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.682715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46383 (local address 127.14.175.194:33803)
0809 02:01:32.683172 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.683188 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:32.683322 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:32.683580 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:32.683583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:32.683601 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:32.683712 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.683719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.684456 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.684458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.685257 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:32.685276 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.685996 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.685999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:32.686122 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.686139 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 02:01:32.686227 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 02:01:32.686334 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":126,"spinlock_wait_cycles":896,"thread_start_us":150,"threads_started":1}
I20260809 02:01:32.687070 1988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ad9c72d01b4663bc913039bdbde6bd" candidate_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c437fcf3e294246a90053dea99b57cc" is_pre_election: true
I20260809 02:01:32.687386 1988 raft_consensus.cc:2454] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5b54d9f49cc4f23a66064c97d0eea7b in term 0.
I20260809 02:01:32.687459 1713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ad9c72d01b4663bc913039bdbde6bd" candidate_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" is_pre_election: true
I20260809 02:01:32.687752 1713 raft_consensus.cc:2454] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5b54d9f49cc4f23a66064c97d0eea7b in term 0.
I20260809 02:01:32.687932 1780 leader_election.cc:302] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c437fcf3e294246a90053dea99b57cc, f5b54d9f49cc4f23a66064c97d0eea7b; no voters:
I20260809 02:01:32.688215 2062 raft_consensus.cc:2781] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:32.688308 2062 raft_consensus.cc:482] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:32.688351 2062 raft_consensus.cc:3037] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:32.689358 2062 raft_consensus.cc:504] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.689689 2062 leader_election.cc:288] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [CANDIDATE]: Term 1 election: Requested vote from peers 1c437fcf3e294246a90053dea99b57cc (127.14.175.195:34601), b8c3f04b36934c43a8d202ee8d96efdd (127.14.175.193:46383)
I20260809 02:01:32.690018 1988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ad9c72d01b4663bc913039bdbde6bd" candidate_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c437fcf3e294246a90053dea99b57cc"
I20260809 02:01:32.690071 1713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ad9c72d01b4663bc913039bdbde6bd" candidate_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c3f04b36934c43a8d202ee8d96efdd"
I20260809 02:01:32.690135 1988 raft_consensus.cc:3037] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:32.690202 1713 raft_consensus.cc:3037] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:32.691167 1988 raft_consensus.cc:2454] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5b54d9f49cc4f23a66064c97d0eea7b in term 1.
I20260809 02:01:32.691443 1713 raft_consensus.cc:2454] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5b54d9f49cc4f23a66064c97d0eea7b in term 1.
I20260809 02:01:32.691470 1780 leader_election.cc:302] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c437fcf3e294246a90053dea99b57cc, f5b54d9f49cc4f23a66064c97d0eea7b; no voters:
I20260809 02:01:32.691637 2062 raft_consensus.cc:2781] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:32.691883 2062 raft_consensus.cc:686] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 1 LEADER]: Becoming Leader. State: Replica: f5b54d9f49cc4f23a66064c97d0eea7b, State: Running, Role: LEADER
I20260809 02:01:32.692210 2062 consensus_queue.cc:237] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } }
I20260809 02:01:32.695169 1562 catalog_manager.cc:5495] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b reported cstate change: term changed from 0 to 1, leader changed from <none> to f5b54d9f49cc4f23a66064c97d0eea7b (127.14.175.194). New cstate: current_term: 1 leader_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5b54d9f49cc4f23a66064c97d0eea7b" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 } health_report { overall_health: UNKNOWN } } }
I20260809 02:01:32.708803 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.705221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.14.175.194:35063)
0809 02:01:32.705353 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:32.705358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:32.705370 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:01:32.705438 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:32.705439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:32.705487 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:32.705597 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:32.705885 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.706441 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.707418 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:32.707632 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:32.707741 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:32.708053 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:32.708420 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:32.708551 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:32.708614 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:01:32.708666 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:01:32.714181 1988 raft_consensus.cc:1261] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 1 FOLLOWER]: Refusing update from remote peer f5b54d9f49cc4f23a66064c97d0eea7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:32.714181 1713 raft_consensus.cc:1261] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 1 FOLLOWER]: Refusing update from remote peer f5b54d9f49cc4f23a66064c97d0eea7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:32.714883 2066 consensus_queue.cc:1035] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c3f04b36934c43a8d202ee8d96efdd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 46383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:32.715119 2062 consensus_queue.cc:1035] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c437fcf3e294246a90053dea99b57cc" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 34601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:32.722049 2069 mvcc.cc:205] Tried to move back new op lower bound from 7316442696550842368 to 7316442696469766144. Current Snapshot: MvccSnapshot[applied={T|T < 7316442696550842368}]
I20260809 02:01:32.724025 2070 mvcc.cc:205] Tried to move back new op lower bound from 7316442696550842368 to 7316442696469766144. Current Snapshot: MvccSnapshot[applied={T|T < 7316442696550842368}]
I20260809 02:01:32.724383 2071 mvcc.cc:205] Tried to move back new op lower bound from 7316442696550842368 to 7316442696469766144. Current Snapshot: MvccSnapshot[applied={T|T < 7316442696550842368}]
I20260809 02:01:32.731243 1561 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:32.731426 1561 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:32.733804 1561 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2df0d02535674dab957e839cdcf0644e: Sending DeleteTablet for 3 replicas of tablet 93ad9c72d01b4663bc913039bdbde6bd
I20260809 02:01:32.734552 1968 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:32 UTC) from {username='slave'} at 127.0.0.1:57752
I20260809 02:01:32.734627 1693 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:32 UTC) from {username='slave'} at 127.0.0.1:33450
I20260809 02:01:32.734782 1827 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ad9c72d01b4663bc913039bdbde6bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:32 UTC) from {username='slave'} at 127.0.0.1:58038
I20260809 02:01:32.735260 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1628
I20260809 02:01:32.735273 2079 tablet_replica.cc:330] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd: stopping tablet replica
I20260809 02:01:32.735596 2079 raft_consensus.cc:2229] T 93ad9c72d01b4663bc913039bdbde6bd P b8c3f04b36934c43a8d202ee8d96efdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:32.736770 2078 tablet_replica.cc:330] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: stopping tablet replica
I20260809 02:01:32.737021 2078 raft_consensus.cc:2229] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:32.737298 2078 raft_consensus.cc:2258] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:32.737541 2080 tablet_replica.cc:330] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: stopping tablet replica
I20260809 02:01:32.737787 2080 raft_consensus.cc:2229] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:32.738130 2080 raft_consensus.cc:2258] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:32.739466 2080 ts_tablet_manager.cc:1905] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:32.740125 2078 ts_tablet_manager.cc:1905] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:32.742178 2080 ts_tablet_manager.cc:1918] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:32.742273 2080 log.cc:1196] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/93ad9c72d01b4663bc913039bdbde6bd
I20260809 02:01:32.742592 2080 ts_tablet_manager.cc:1939] T 93ad9c72d01b4663bc913039bdbde6bd P f5b54d9f49cc4f23a66064c97d0eea7b: Deleting consensus metadata
I20260809 02:01:32.743221 2078 ts_tablet_manager.cc:1918] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:32.743384 2078 log.cc:1196] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/93ad9c72d01b4663bc913039bdbde6bd
I20260809 02:01:32.743750 2078 ts_tablet_manager.cc:1939] T 93ad9c72d01b4663bc913039bdbde6bd P 1c437fcf3e294246a90053dea99b57cc: Deleting consensus metadata
W20260809 02:01:32.744597 1548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:46383 (error 108)
I20260809 02:01:32.744951 1546 catalog_manager.cc:4841] TS 1c437fcf3e294246a90053dea99b57cc (127.14.175.195:34601): tablet 93ad9c72d01b4663bc913039bdbde6bd (table test-table [id=cb58266498f04ceda9b6858c4da44260]) successfully deleted
I20260809 02:01:32.745072 1548 catalog_manager.cc:4841] TS f5b54d9f49cc4f23a66064c97d0eea7b (127.14.175.194:35063): tablet 93ad9c72d01b4663bc913039bdbde6bd (table test-table [id=cb58266498f04ceda9b6858c4da44260]) successfully deleted
I20260809 02:01:32.745554 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1764
I20260809 02:01:32.747190 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:32.745816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:46383 (local address 127.0.0.1:33460)
0809 02:01:32.747014 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:32.747091 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:46383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1079}
W20260809 02:01:32.751096 1548 catalog_manager.cc:4584] TS b8c3f04b36934c43a8d202ee8d96efdd (127.14.175.193:46383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93ad9c72d01b4663bc913039bdbde6bd: Network error: Client connection negotiation failed: client connection to 127.14.175.193:46383: connect: Connection refused (error 111)
I20260809 02:01:32.752867 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1899
I20260809 02:01:32.759477 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 1531
2026-08-09T02:01:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (972 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:32 dist-test-slave-2w3w krb5kdc[2085](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:32 dist-test-slave-2w3w krb5kdc[2085](info): set up 2 sockets
Aug 09 02:01:32 dist-test-slave-2w3w krb5kdc[2085](info): commencing operation
krb5kdc: starting...
W20260809 02:01:33.849943 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:33 dist-test-slave-2w3w krb5kdc[2085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:01:33.977777 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33095
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:42123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:33095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:34.087963 2099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:34.088219 2099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:34.088261 2099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:34.092295 2099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:34.092350 2099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:34.092370 2099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:34.092386 2099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:34.092449 2099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:34.097692 2099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:33095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:34.098712 2099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:34.099753 2099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:34.108213 2107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.108193 2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.108484 2104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:34.108534 2099 server_base.cc:1034] running on GCE node
I20260809 02:01:34.109019 2099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:34.110004 2099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:34.111166 2099 hybrid_clock.cc:648] HybridClock initialized: now 1786240894111146 us; error 30 us; skew 500 ppm
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:34.113940 2099 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:34.114869 2099 webserver.cc:460] Webserver started at http://127.14.175.254:44009/ using document root <none> and password file <none>
I20260809 02:01:34.115437 2099 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:34.115532 2099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:34.115777 2099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:34.117743 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "0cf7e77a61144b0e887e6036c8ae8040"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "0f5e1380d4cf0656e169eca006edf6c1"
server_key_iv: "820e689d1993c73d13deacbcd7c12ed1"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.118302 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "0cf7e77a61144b0e887e6036c8ae8040"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "0f5e1380d4cf0656e169eca006edf6c1"
server_key_iv: "820e689d1993c73d13deacbcd7c12ed1"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.121970 2099 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:01:34.124361 2114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.125468 2099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:34.125612 2099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "0cf7e77a61144b0e887e6036c8ae8040"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "0f5e1380d4cf0656e169eca006edf6c1"
server_key_iv: "820e689d1993c73d13deacbcd7c12ed1"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.125725 2099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:34.141402 2099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:34.144410 2099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:34.144606 2099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:34.151829 2099 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:33095
I20260809 02:01:34.151861 2167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:33095 every 8 connection(s)
I20260809 02:01:34.152732 2099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:34.154464 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2099
I20260809 02:01:34.154624 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:34.154947 15039 external_mini_cluster.cc:1428] Setting key 257439aafee52c7ccb43c68a2cc7dceb
I20260809 02:01:34.155576 2169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:34.162469 2169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: Bootstrap starting.
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:34.165450 2169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:34.166446 2169 log.cc:824] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:34.168913 2169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: No bootstrap required, opened a new log
I20260809 02:01:34.172781 2169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } }
I20260809 02:01:34.173028 2169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:34.173099 2169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cf7e77a61144b0e887e6036c8ae8040, State: Initialized, Role: FOLLOWER
I20260809 02:01:34.173559 2169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } }
I20260809 02:01:34.173722 2169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:34.173794 2169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:34.173911 2169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:34.174958 2169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } }
I20260809 02:01:34.175299 2172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.156371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36748 (local address 127.14.175.254:33095)
0809 02:01:34.156792 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.156810 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.156851 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:01:34.157696 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.157719 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.158134 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.158488 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:34.159254 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.160724 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.161594 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.162261 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.162417 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.166026 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:34.166033 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:34.166049 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:34.166104 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:34.172118 (+ 6014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.172664 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.172670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.172675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.172798 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.173123 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.173127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.173129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.173578 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:34.173782 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.174110 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.174423 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":128,"threads_started":1}
I20260809 02:01:34.175348 2169 leader_election.cc:302] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cf7e77a61144b0e887e6036c8ae8040; no voters:
I20260809 02:01:34.175661 2169 leader_election.cc:288] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:34.175740 2174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:34.175926 2174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [term 1 LEADER]: Becoming Leader. State: Replica: 0cf7e77a61144b0e887e6036c8ae8040, State: Running, Role: LEADER
I20260809 02:01:34.176194 2174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } }
I20260809 02:01:34.176743 2169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:34.177289 2174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cf7e77a61144b0e887e6036c8ae8040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } } }
I20260809 02:01:34.177438 2174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:34.177664 2174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cf7e77a61144b0e887e6036c8ae8040. Latest consensus state: current_term: 1 leader_uuid: "0cf7e77a61144b0e887e6036c8ae8040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf7e77a61144b0e887e6036c8ae8040" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33095 } } }
I20260809 02:01:34.177755 2174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:34.179219 2180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:34.182148 2180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:34.187747 2180 catalog_manager.cc:1347] Generated new cluster ID: a6a3cb17235540e69e20ce46bcf45360
I20260809 02:01:34.187814 2180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:34.218515 2180 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:34.219853 2180 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:34.226368 2180 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: Generated new TSK 0
I20260809 02:01:34.227188 2180 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:01:34.259900 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:42123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:34.371666 2197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:34.371969 2197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:34.372063 2197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:34.378098 2197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:34.378186 2197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:34.378314 2197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:34.387298 2197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:34.388703 2197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:34.389953 2197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:34.402132 2206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.402204 2204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.402150 2203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:34.403367 2197 server_base.cc:1034] running on GCE node
I20260809 02:01:34.403824 2197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:34.404567 2197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:34.405772 2197 hybrid_clock.cc:648] HybridClock initialized: now 1786240894405754 us; error 40 us; skew 500 ppm
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:34.409541 2197 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:01:34.410691 2197 webserver.cc:460] Webserver started at http://127.14.175.193:35569/ using document root <none> and password file <none>
I20260809 02:01:34.411461 2197 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:34.411558 2197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:34.411823 2197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:34.414796 2197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "85e34013e45a44ec85dba33949b5e5d9"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "44d99fb201abf34db9ef30909075d11b"
server_key_iv: "10ed0b1ba1f58120487a7ba4590ac35d"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.415586 2197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "85e34013e45a44ec85dba33949b5e5d9"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "44d99fb201abf34db9ef30909075d11b"
server_key_iv: "10ed0b1ba1f58120487a7ba4590ac35d"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.420866 2197 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 02:01:34.424139 2213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.425691 2197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:01:34.425827 2197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "85e34013e45a44ec85dba33949b5e5d9"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "44d99fb201abf34db9ef30909075d11b"
server_key_iv: "10ed0b1ba1f58120487a7ba4590ac35d"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.425943 2197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:34.446677 2197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:34.450362 2197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:34.450523 2197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:34.451128 2197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:34.451968 2197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:34.452021 2197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.452064 2197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:34.452090 2197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.461664 2197 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:43883
I20260809 02:01:34.461704 2331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:43883 every 8 connection(s)
I20260809 02:01:34.462556 2197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:34.467163 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2197
I20260809 02:01:34.467320 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:34.467669 15039 external_mini_cluster.cc:1428] Setting key 6ef3b5982b81d96793c51ababa5ffb31
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:34.477428 2172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.464342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:52233 (local address 127.14.175.254:33095)
0809 02:01:34.464492 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.464496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.465324 (+ 828us) server_negotiation.cc:407] Connection header received
0809 02:01:34.466612 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.466615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.466661 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.466736 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:34.468318 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.468951 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.470132 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.470536 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.470662 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.473428 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:34.473431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:34.473433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:34.473456 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:34.475106 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.475620 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.475627 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.475631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.475737 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.476095 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.476101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.476104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.476357 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:34.476471 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.477074 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.477226 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:01:34.478181 2334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.464704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33095 (local address 127.14.175.193:52233)
0809 02:01:34.465164 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.465207 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.466419 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.466981 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.466991 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.467541 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:34.468181 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.468197 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.469083 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.469086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.469998 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.470008 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.470685 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.470687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.470828 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.471508 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:34.471532 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:34.473261 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:34.475240 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.475245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.475255 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.475512 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.475852 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.475854 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.475856 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.475985 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.476539 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:34.476563 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:34.476799 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.476983 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.477219 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":124,"threads_started":1}
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 02:01:34.479409 2332 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33095
I20260809 02:01:34.479648 2332 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:34.480180 2332 heartbeater.cc:511] Master 127.14.175.254:33095 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
I20260809 02:01:34.481796 2131 ts_manager.cc:194] Registered new tserver with Master: 85e34013e45a44ec85dba33949b5e5d9 (127.14.175.193:43883)
I20260809 02:01:34.483501 2131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:52233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 02:01:34.496014 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:42123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:34.603974 2338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:34.604238 2338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:34.604305 2338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:34.608214 2338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:34.608287 2338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:34.608384 2338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:34.613682 2338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:34.614645 2338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:34.615636 2338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:34.624846 2344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.624965 2346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.624965 2343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:34.625209 2338 server_base.cc:1034] running on GCE node
I20260809 02:01:34.625593 2338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:34.626214 2338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:34.627400 2338 hybrid_clock.cc:648] HybridClock initialized: now 1786240894627355 us; error 59 us; skew 500 ppm
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:34.630333 2338 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:01:34.631254 2338 webserver.cc:460] Webserver started at http://127.14.175.194:46211/ using document root <none> and password file <none>
I20260809 02:01:34.631829 2338 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:34.631889 2338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:34.632045 2338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:34.633934 2338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "e798bee1bf1e449fab331a621014f817"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "9b4363da94a95e55bc1583932dcc0a56"
server_key_iv: "22f2f457fa9c0a76156f96787b77e23c"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.634434 2338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "e798bee1bf1e449fab331a621014f817"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "9b4363da94a95e55bc1583932dcc0a56"
server_key_iv: "22f2f457fa9c0a76156f96787b77e23c"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.637976 2338 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:01:34.640409 2355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.641636 2338 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:34.641835 2338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "e798bee1bf1e449fab331a621014f817"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "9b4363da94a95e55bc1583932dcc0a56"
server_key_iv: "22f2f457fa9c0a76156f96787b77e23c"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.641930 2338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:34.654572 2338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:34.657285 2338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:34.657473 2338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:34.658011 2338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:34.658761 2338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:34.658813 2338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.658876 2338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:34.658913 2338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.667505 2338 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:36603
I20260809 02:01:34.667551 2470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:36603 every 8 connection(s)
I20260809 02:01:34.668382 2338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:34.672261 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2338
I20260809 02:01:34.672430 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:34.672739 15039 external_mini_cluster.cc:1428] Setting key b16949f0be83747f963fa9b907e6207c
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:34.682317 2172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.670049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:47311 (local address 127.14.175.254:33095)
0809 02:01:34.670182 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.670185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.670923 (+ 738us) server_negotiation.cc:407] Connection header received
0809 02:01:34.672216 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.672220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.672280 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.672389 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:34.673585 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.674117 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.675318 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.675545 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.675653 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.678428 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:34.678432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:34.678435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:34.678460 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:34.680065 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.680594 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.680599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.680601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.680690 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.681045 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.681049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.681051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.681234 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:34.681339 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.681982 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.682115 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:01:34.683307 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.670363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33095 (local address 127.14.175.194:47311)
0809 02:01:34.670768 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.670808 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.672004 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.672562 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.672569 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.672886 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:34.673437 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.673453 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.674276 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.674280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.675182 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.675192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.675699 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.675703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.675863 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.676439 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:34.676464 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:34.678269 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:34.680204 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.680210 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.680223 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.680484 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.680793 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.680796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.680798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.680940 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.681353 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:34.681361 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:34.681685 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.681899 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.682221 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 02:01:34.687566 2471 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33095
I20260809 02:01:34.687813 2471 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:34.688279 2471 heartbeater.cc:511] Master 127.14.175.254:33095 requested a full tablet report, sending...
I20260809 02:01:34.689495 2131 ts_manager.cc:194] Registered new tserver with Master: e798bee1bf1e449fab331a621014f817 (127.14.175.194:36603)
I20260809 02:01:34.690434 2131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:47311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:01:34.707932 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:42123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:34.819660 2477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:34.819931 2477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:34.819999 2477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:34.824740 2477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:34.824831 2477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:34.824921 2477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:34.830687 2477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:42123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:33095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:34.831696 2477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:34.832834 2477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:34.842650 2484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.842669 2483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:34.842669 2486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:34.843127 2477 server_base.cc:1034] running on GCE node
I20260809 02:01:34.843523 2477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:34.844209 2477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:34.845402 2477 hybrid_clock.cc:648] HybridClock initialized: now 1786240894845381 us; error 37 us; skew 500 ppm
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:34.848624 2477 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:01:34.849553 2477 webserver.cc:460] Webserver started at http://127.14.175.195:39209/ using document root <none> and password file <none>
I20260809 02:01:34.850143 2477 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:34.850241 2477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:34.850497 2477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:34.852761 2477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "1db3af926e914f989dd0e2ecbf920c28"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "314cb90ec9c96ff01ff6e30fb4605477"
server_key_iv: "69959ee74bc5af3c3be45d06a542e33b"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.853334 2477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "1db3af926e914f989dd0e2ecbf920c28"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "314cb90ec9c96ff01ff6e30fb4605477"
server_key_iv: "69959ee74bc5af3c3be45d06a542e33b"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.857185 2477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 02:01:34.859577 2493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.860797 2477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:34.860909 2477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "1db3af926e914f989dd0e2ecbf920c28"
format_stamp: "Formatted at 2026-08-09 02:01:34 on dist-test-slave-2w3w"
server_key: "314cb90ec9c96ff01ff6e30fb4605477"
server_key_iv: "69959ee74bc5af3c3be45d06a542e33b"
server_key_version: "encryptionkey@0"
I20260809 02:01:34.861017 2477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:34.873014 2477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:34.876382 2477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:34.876573 2477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:34.877121 2477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:34.877993 2477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:34.878041 2477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.878077 2477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:34.878099 2477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:34.886651 2477 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:38565
I20260809 02:01:34.886718 2613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:38565 every 8 connection(s)
I20260809 02:01:34.887583 2477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:34.895677 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2477
I20260809 02:01:34.895821 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:34.896202 15039 external_mini_cluster.cc:1428] Setting key 1b669324e3e345da35dcc9259e4a7e5d
Aug 09 02:01:34 dist-test-slave-2w3w krb5kdc[2085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240894, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:34.901284 2172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.889320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:44503 (local address 127.14.175.254:33095)
0809 02:01:34.889482 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.889487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.890257 (+ 770us) server_negotiation.cc:407] Connection header received
0809 02:01:34.891551 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.891554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.891603 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.891671 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:34.892732 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.893254 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.894317 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.894539 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.894617 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.897699 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:34.897702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:34.897705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:34.897727 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:34.899271 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.899774 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.899779 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.899781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.899861 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.900194 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.900198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.900200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.900378 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:34.900483 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.900968 (+ 485us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.901121 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:01:34.901983 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.889689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:33095 (local address 127.14.175.195:44503)
0809 02:01:34.890112 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.890153 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.891347 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.891820 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.891826 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.892157 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:34.892593 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.892607 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.893359 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.893361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.894214 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.894223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.894664 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.894667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.894808 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.895458 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:34.895482 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:34.897529 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:34.899399 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.899404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.899418 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.899670 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.899954 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:34.899959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:34.899961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:34.900099 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:34.900489 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:34.900497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:34.900750 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.900927 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.901247 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":116,"threads_started":1}
I20260809 02:01:34.903009 2614 heartbeater.cc:347] Connected to a master server at 127.14.175.254:33095
I20260809 02:01:34.903245 2614 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:34.903697 2614 heartbeater.cc:511] Master 127.14.175.254:33095 requested a full tablet report, sending...
I20260809 02:01:34.904655 2131 ts_manager.cc:194] Registered new tserver with Master: 1db3af926e914f989dd0e2ecbf920c28 (127.14.175.195:38565)
I20260809 02:01:34.905198 2131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:44503
I20260809 02:01:34.910025 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:34.919170 2172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.912036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36756 (local address 127.14.175.254:33095)
0809 02:01:34.912145 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.912148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.912311 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:01:34.912400 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.912402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.912437 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.912504 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:34.913190 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.913676 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.914453 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.914660 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.914733 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.916192 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:34.916195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:34.916197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:34.916217 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:34.917603 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.918035 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.918037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.918038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.918106 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:34.918364 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:34.918366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:34.918367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:34.918543 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:34.918654 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.918868 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.918939 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:01:34.921907 2131 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:34.924988 2131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:34.939343 2626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.933270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:38565 (local address 127.0.0.1:41188)
0809 02:01:34.934452 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.934466 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.934557 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.935088 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.935091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.935108 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:34.935204 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.935214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936294 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.936300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.937944 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.937954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.938786 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.938789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.938895 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.938931 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.939077 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.939194 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1126,"mutex_wait_us":106,"thread_start_us":126,"threads_started":1}
I20260809 02:01:34.939347 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.933813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41188 (local address 127.14.175.195:38565)
0809 02:01:34.934173 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.934188 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.934658 (+ 470us) server_negotiation.cc:407] Connection header received
0809 02:01:34.934741 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.934746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.934929 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.935110 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:34.935301 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936164 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.938086 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.938659 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.938800 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.938932 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.939107 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.939201 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":166,"threads_started":1}
I20260809 02:01:34.939720 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.933778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43883 (local address 127.0.0.1:57466)
0809 02:01:34.934696 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.934710 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.934825 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.935494 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.935497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.935515 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:34.935590 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.935595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936761 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.936765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.937827 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.937837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.939199 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.939202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.939352 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.939423 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.939515 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.939592 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"mutex_wait_us":41,"thread_start_us":96,"threads_started":1}
I20260809 02:01:34.940136 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.933100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:36603 (local address 127.0.0.1:47836)
0809 02:01:34.933657 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:34.933706 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:34.933822 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:34.934456 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:34.934462 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:34.934487 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:34.934701 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.934712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936364 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.936366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.937943 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:34.937954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.939199 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.939202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:34.939333 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.939760 (+ 427us) client_negotiation.cc:769] Sending connection context
0809 02:01:34.939929 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 02:01:34.940003 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":539,"thread_start_us":67,"threads_started":1}
I20260809 02:01:34.940171 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.934329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57466 (local address 127.14.175.193:43883)
0809 02:01:34.935075 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.935081 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.935101 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:01:34.935173 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.935177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.935341 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.935492 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:34.935681 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936627 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.937953 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.938859 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.939005 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.939130 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.939909 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.940005 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":76,"threads_started":1}
I20260809 02:01:34.941000 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:34.933274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47836 (local address 127.14.175.194:36603)
0809 02:01:34.933922 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:34.933937 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:34.933964 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:01:34.934056 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:34.934061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:34.934263 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:34.934894 (+ 631us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:34.935089 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.936243 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.938076 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:34.938859 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:34.939019 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:34.939130 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:34.940741 (+ 1611us) server_negotiation.cc:299] Negotiation successful
0809 02:01:34.940838 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":127,"threads_started":1}
I20260809 02:01:34.942431 2544 tablet_service.cc:1467] Processing CreateTablet for tablet 772909429a934b708a5b9103e6d58a2a (DEFAULT_TABLE table=test-table [id=c7f24cb3426e47b8a8d5564659c22f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:34.942674 2263 tablet_service.cc:1467] Processing CreateTablet for tablet 772909429a934b708a5b9103e6d58a2a (DEFAULT_TABLE table=test-table [id=c7f24cb3426e47b8a8d5564659c22f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:34.943125 2404 tablet_service.cc:1467] Processing CreateTablet for tablet 772909429a934b708a5b9103e6d58a2a (DEFAULT_TABLE table=test-table [id=c7f24cb3426e47b8a8d5564659c22f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:34.943585 2263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772909429a934b708a5b9103e6d58a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:34.943583 2544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772909429a934b708a5b9103e6d58a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:34.944067 2404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772909429a934b708a5b9103e6d58a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:34.950241 2632 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Bootstrap starting.
I20260809 02:01:34.951725 2633 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Bootstrap starting.
I20260809 02:01:34.952637 2632 tablet_bootstrap.cc:654] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:34.953863 2633 tablet_bootstrap.cc:654] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:34.953990 2632 log.cc:824] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:34.954813 2634 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: Bootstrap starting.
I20260809 02:01:34.955175 2633 log.cc:824] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:34.956256 2632 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: No bootstrap required, opened a new log
I20260809 02:01:34.956458 2632 ts_tablet_manager.cc:1397] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:01:34.957126 2633 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: No bootstrap required, opened a new log
I20260809 02:01:34.957306 2633 ts_tablet_manager.cc:1397] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:01:34.957345 2634 tablet_bootstrap.cc:654] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:34.958110 2634 log.cc:824] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:34.960048 2634 tablet_bootstrap.cc:492] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: No bootstrap required, opened a new log
I20260809 02:01:34.959887 2632 raft_consensus.cc:348] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.960170 2632 raft_consensus.cc:374] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:34.960222 2634 ts_tablet_manager.cc:1397] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:01:34.960230 2632 raft_consensus.cc:729] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e798bee1bf1e449fab331a621014f817, State: Initialized, Role: FOLLOWER
I20260809 02:01:34.960739 2632 consensus_queue.cc:260] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.960976 2633 raft_consensus.cc:348] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.961232 2633 raft_consensus.cc:374] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:34.961292 2633 raft_consensus.cc:729] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db3af926e914f989dd0e2ecbf920c28, State: Initialized, Role: FOLLOWER
I20260809 02:01:34.961870 2471 heartbeater.cc:503] Master 127.14.175.254:33095 was elected leader, sending a full tablet report...
I20260809 02:01:34.961802 2633 consensus_queue.cc:260] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.962047 2632 ts_tablet_manager.cc:1428] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:01:34.962718 2633 ts_tablet_manager.cc:1428] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:01:34.963068 2614 heartbeater.cc:503] Master 127.14.175.254:33095 was elected leader, sending a full tablet report...
I20260809 02:01:34.964063 2634 raft_consensus.cc:348] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.964349 2634 raft_consensus.cc:374] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:34.964412 2634 raft_consensus.cc:729] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e34013e45a44ec85dba33949b5e5d9, State: Initialized, Role: FOLLOWER
I20260809 02:01:34.964861 2634 consensus_queue.cc:260] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:34.965517 2332 heartbeater.cc:503] Master 127.14.175.254:33095 was elected leader, sending a full tablet report...
I20260809 02:01:34.965852 2634 ts_tablet_manager.cc:1428] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:01:35.000145 2640 raft_consensus.cc:482] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:35.000358 2640 raft_consensus.cc:504] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:35.001485 2640 leader_election.cc:288] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e798bee1bf1e449fab331a621014f817 (127.14.175.194:36603), 1db3af926e914f989dd0e2ecbf920c28 (127.14.175.195:38565)
I20260809 02:01:35.005618 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.001999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:57671 (local address 127.14.175.195:38565)
0809 02:01:35.002128 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.002133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.002224 (+ 91us) server_negotiation.cc:407] Connection header received
0809 02:01:35.002336 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.002339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.002394 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.002484 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:35.002793 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.003406 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.004571 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.004978 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.005109 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.005173 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.005415 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.005487 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:01:35.005620 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.001866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:35279 (local address 127.14.175.194:36603)
0809 02:01:35.002026 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.002031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.002367 (+ 336us) server_negotiation.cc:407] Connection header received
0809 02:01:35.002461 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.002467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.002522 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.002598 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:35.002938 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.003538 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.004595 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.004987 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.005122 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.005174 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.005445 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.005517 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 02:01:35.005643 2641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.001750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:38565 (local address 127.14.175.193:57671)
0809 02:01:35.002127 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.002151 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.002242 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.002497 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.002500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.002517 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:35.002662 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.002669 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.003521 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.003525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.004427 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.004437 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.005104 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.005107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.005223 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.005308 (+ 85us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.005372 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.005468 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":51,"thread_start_us":103,"threads_started":1}
I20260809 02:01:35.005649 2642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.001750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:36603 (local address 127.14.175.193:35279)
0809 02:01:35.002230 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.002247 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.002361 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.002633 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.002636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.002654 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:35.002787 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.002794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.003662 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.003664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.004438 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.004446 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.005155 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.005159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.005280 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.005319 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.005413 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.005484 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":175,"thread_start_us":93,"threads_started":1}
I20260809 02:01:35.006346 2566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772909429a934b708a5b9103e6d58a2a" candidate_uuid: "85e34013e45a44ec85dba33949b5e5d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db3af926e914f989dd0e2ecbf920c28" is_pre_election: true
I20260809 02:01:35.006419 2424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772909429a934b708a5b9103e6d58a2a" candidate_uuid: "85e34013e45a44ec85dba33949b5e5d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e798bee1bf1e449fab331a621014f817" is_pre_election: true
I20260809 02:01:35.006687 2566 raft_consensus.cc:2454] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e34013e45a44ec85dba33949b5e5d9 in term 0.
I20260809 02:01:35.006706 2424 raft_consensus.cc:2454] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85e34013e45a44ec85dba33949b5e5d9 in term 0.
I20260809 02:01:35.007207 2216 leader_election.cc:302] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e34013e45a44ec85dba33949b5e5d9, e798bee1bf1e449fab331a621014f817; no voters:
I20260809 02:01:35.007513 2640 raft_consensus.cc:2781] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:35.007604 2640 raft_consensus.cc:482] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:35.007637 2640 raft_consensus.cc:3037] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:35.008723 2640 raft_consensus.cc:504] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:35.009117 2640 leader_election.cc:288] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [CANDIDATE]: Term 1 election: Requested vote from peers e798bee1bf1e449fab331a621014f817 (127.14.175.194:36603), 1db3af926e914f989dd0e2ecbf920c28 (127.14.175.195:38565)
I20260809 02:01:35.009512 2566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772909429a934b708a5b9103e6d58a2a" candidate_uuid: "85e34013e45a44ec85dba33949b5e5d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db3af926e914f989dd0e2ecbf920c28"
I20260809 02:01:35.009528 2424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772909429a934b708a5b9103e6d58a2a" candidate_uuid: "85e34013e45a44ec85dba33949b5e5d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e798bee1bf1e449fab331a621014f817"
I20260809 02:01:35.009651 2566 raft_consensus.cc:3037] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:35.009681 2424 raft_consensus.cc:3037] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:35.011097 2424 raft_consensus.cc:2454] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e34013e45a44ec85dba33949b5e5d9 in term 1.
I20260809 02:01:35.011179 2566 raft_consensus.cc:2454] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85e34013e45a44ec85dba33949b5e5d9 in term 1.
I20260809 02:01:35.011407 2216 leader_election.cc:302] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85e34013e45a44ec85dba33949b5e5d9, e798bee1bf1e449fab331a621014f817; no voters:
I20260809 02:01:35.011686 2640 raft_consensus.cc:2781] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:35.011914 2640 raft_consensus.cc:686] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 1 LEADER]: Becoming Leader. State: Replica: 85e34013e45a44ec85dba33949b5e5d9, State: Running, Role: LEADER
I20260809 02:01:35.012254 2640 consensus_queue.cc:237] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } }
I20260809 02:01:35.015409 2129 catalog_manager.cc:5495] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85e34013e45a44ec85dba33949b5e5d9 (127.14.175.193). New cstate: current_term: 1 leader_uuid: "85e34013e45a44ec85dba33949b5e5d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85e34013e45a44ec85dba33949b5e5d9" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260809 02:01:35.038494 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.034308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57472 (local address 127.14.175.193:43883)
0809 02:01:35.034450 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.034457 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.034473 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:01:35.034659 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.034662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.034726 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.034855 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:35.035150 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.035685 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.036971 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.037207 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.037317 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.037621 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:35.038004 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:35.038168 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.038279 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.038321 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:01:35.044059 2424 raft_consensus.cc:1261] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 1 FOLLOWER]: Refusing update from remote peer 85e34013e45a44ec85dba33949b5e5d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:35.044066 2566 raft_consensus.cc:1261] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 1 FOLLOWER]: Refusing update from remote peer 85e34013e45a44ec85dba33949b5e5d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:35.044821 2643 consensus_queue.cc:1035] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db3af926e914f989dd0e2ecbf920c28" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:35.045079 2640 consensus_queue.cc:1035] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e798bee1bf1e449fab331a621014f817" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:35.053223 2647 mvcc.cc:205] Tried to move back new op lower bound from 7316442706093572096 to 7316442705972633600. Current Snapshot: MvccSnapshot[applied={T|T < 7316442706093572096}]
I20260809 02:01:35.054129 2649 mvcc.cc:205] Tried to move back new op lower bound from 7316442706093572096 to 7316442705972633600. Current Snapshot: MvccSnapshot[applied={T|T < 7316442706093572096}]
I20260809 02:01:35.056747 2648 mvcc.cc:205] Tried to move back new op lower bound from 7316442706093572096 to 7316442705972633600. Current Snapshot: MvccSnapshot[applied={T|T < 7316442706093572096}]
I20260809 02:01:35.063149 2131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:35.063290 2131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:35.065788 2131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0cf7e77a61144b0e887e6036c8ae8040: Sending DeleteTablet for 3 replicas of tablet 772909429a934b708a5b9103e6d58a2a
I20260809 02:01:35.066535 2404 tablet_service.cc:1514] Processing DeleteTablet for tablet 772909429a934b708a5b9103e6d58a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:35 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:47836
I20260809 02:01:35.066542 2544 tablet_service.cc:1514] Processing DeleteTablet for tablet 772909429a934b708a5b9103e6d58a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:35 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:41188
I20260809 02:01:35.066666 2263 tablet_service.cc:1514] Processing DeleteTablet for tablet 772909429a934b708a5b9103e6d58a2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:35 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:57466
I20260809 02:01:35.067150 2658 tablet_replica.cc:330] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9: stopping tablet replica
I20260809 02:01:35.067209 2657 tablet_replica.cc:330] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: stopping tablet replica
I20260809 02:01:35.067446 2657 raft_consensus.cc:2229] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:35.067454 2658 raft_consensus.cc:2229] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:35.067731 2657 raft_consensus.cc:2258] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:35.067806 2658 raft_consensus.cc:2258] T 772909429a934b708a5b9103e6d58a2a P 85e34013e45a44ec85dba33949b5e5d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:35.067880 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2197
I20260809 02:01:35.068419 2656 tablet_replica.cc:330] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: stopping tablet replica
I20260809 02:01:35.068713 2656 raft_consensus.cc:2229] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:35.068962 2656 raft_consensus.cc:2258] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:35.071059 2656 ts_tablet_manager.cc:1905] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:35.071784 2657 ts_tablet_manager.cc:1905] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:35.073954 2656 ts_tablet_manager.cc:1918] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:35.074054 2656 log.cc:1196] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/772909429a934b708a5b9103e6d58a2a
I20260809 02:01:35.074404 2656 ts_tablet_manager.cc:1939] T 772909429a934b708a5b9103e6d58a2a P 1db3af926e914f989dd0e2ecbf920c28: Deleting consensus metadata
I20260809 02:01:35.074621 2657 ts_tablet_manager.cc:1918] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:35.074723 2657 log.cc:1196] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/772909429a934b708a5b9103e6d58a2a
I20260809 02:01:35.075096 2657 ts_tablet_manager.cc:1939] T 772909429a934b708a5b9103e6d58a2a P e798bee1bf1e449fab331a621014f817: Deleting consensus metadata
I20260809 02:01:35.075743 2116 catalog_manager.cc:4841] TS 1db3af926e914f989dd0e2ecbf920c28 (127.14.175.195:38565): tablet 772909429a934b708a5b9103e6d58a2a (table test-table [id=c7f24cb3426e47b8a8d5564659c22f0b]) successfully deleted
I20260809 02:01:35.076226 2117 catalog_manager.cc:4841] TS e798bee1bf1e449fab331a621014f817 (127.14.175.194:36603): tablet 772909429a934b708a5b9103e6d58a2a (table test-table [id=c7f24cb3426e47b8a8d5564659c22f0b]) successfully deleted
W20260809 02:01:35.076465 2117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:43883 (error 108)
I20260809 02:01:35.076643 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2338
I20260809 02:01:35.078490 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.078153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43883 (local address 127.0.0.1:57484)
0809 02:01:35.078328 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.078396 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260809 02:01:35.078671 2117 catalog_manager.cc:4584] TS 85e34013e45a44ec85dba33949b5e5d9 (127.14.175.193:43883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 772909429a934b708a5b9103e6d58a2a: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43883: connect: Connection refused (error 111)
I20260809 02:01:35.084261 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2477
I20260809 02:01:35.091228 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2099
2026-08-09T02:01:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2332 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T02:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:35Z Disabled control of system clock
I20260809 02:01:35.123476 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37447
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:43337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:37447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:35.232017 2663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:35.232277 2663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:35.232319 2663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:35.236202 2663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:35.236254 2663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:35.236269 2663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:35.236286 2663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:35.236307 2663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:35.241026 2663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:37447
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:37447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:35.241997 2663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:35.243278 2663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:35.251300 2669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.251309 2671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.251310 2668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.251595 2663 server_base.cc:1034] running on GCE node
I20260809 02:01:35.252266 2663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:35.253278 2663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:35.254490 2663 hybrid_clock.cc:648] HybridClock initialized: now 1786240895254458 us; error 47 us; skew 500 ppm
I20260809 02:01:35.256546 2663 webserver.cc:460] Webserver started at http://127.14.175.254:45145/ using document root <none> and password file <none>
I20260809 02:01:35.257226 2663 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:35.257326 2663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:35.257530 2663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:35.259614 2663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "30ec8555053c4d3c8b8010b226cbf28c"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "ec1f8a5a1c963ab665a844d6258e01f8"
server_key_iv: "1c996d9354fdb31af114f6d997b7da9f"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.260164 2663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "30ec8555053c4d3c8b8010b226cbf28c"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "ec1f8a5a1c963ab665a844d6258e01f8"
server_key_iv: "1c996d9354fdb31af114f6d997b7da9f"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.263537 2663 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:01:35.265712 2677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.266829 2663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:35.267004 2663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "30ec8555053c4d3c8b8010b226cbf28c"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "ec1f8a5a1c963ab665a844d6258e01f8"
server_key_iv: "1c996d9354fdb31af114f6d997b7da9f"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.267117 2663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:35.285916 2663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:35.286525 2663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:35.286715 2663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:35.293491 2663 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:37447
I20260809 02:01:35.293500 2732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:37447 every 8 connection(s)
I20260809 02:01:35.294370 2663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:35.297341 2733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:35.299238 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2663
I20260809 02:01:35.299381 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:35.299666 15039 external_mini_cluster.cc:1428] Setting key c635a07036bc109c4f826efc0fa42bd2
I20260809 02:01:35.302912 2733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: Bootstrap starting.
I20260809 02:01:35.304963 2733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:35.305711 2733 log.cc:824] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:35.307523 2733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: No bootstrap required, opened a new log
I20260809 02:01:35.308357 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.301022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.14.175.254:37447)
0809 02:01:35.301625 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.301638 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.301670 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:01:35.302282 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.302306 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.302655 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.302963 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:35.303399 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.304324 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.305277 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.305742 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.305918 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.306746 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:35.306751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:35.306762 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:35.307180 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:35.307235 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:35.307254 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:35.307360 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.307472 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.307730 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":136,"threads_started":1}
I20260809 02:01:35.311127 2733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } }
I20260809 02:01:35.311327 2733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:35.311404 2733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30ec8555053c4d3c8b8010b226cbf28c, State: Initialized, Role: FOLLOWER
I20260809 02:01:35.311781 2733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } }
I20260809 02:01:35.311896 2733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:35.311964 2733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:35.312080 2733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:35.312907 2733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } }
I20260809 02:01:35.313230 2733 leader_election.cc:302] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30ec8555053c4d3c8b8010b226cbf28c; no voters:
I20260809 02:01:35.313515 2733 leader_election.cc:288] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:35.313587 2739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:35.313874 2739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [term 1 LEADER]: Becoming Leader. State: Replica: 30ec8555053c4d3c8b8010b226cbf28c, State: Running, Role: LEADER
I20260809 02:01:35.314155 2739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } }
I20260809 02:01:35.314661 2733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:35.316008 2740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30ec8555053c4d3c8b8010b226cbf28c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } } }
I20260809 02:01:35.316125 2741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30ec8555053c4d3c8b8010b226cbf28c. Latest consensus state: current_term: 1 leader_uuid: "30ec8555053c4d3c8b8010b226cbf28c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ec8555053c4d3c8b8010b226cbf28c" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 37447 } } }
I20260809 02:01:35.316162 2740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:35.316210 2741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:35.317317 2750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:35.319825 2750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:35.325006 2750 catalog_manager.cc:1347] Generated new cluster ID: 4fd5f41706594ce99a00d52f5770e3bb
I20260809 02:01:35.325067 2750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:35.339740 2750 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:35.340866 2750 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:35.362247 2750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: Generated new TSK 0
I20260809 02:01:35.362931 2750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:35.367681 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--builtin_ntp_servers=127.14.175.212:43337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:35.478289 2758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:35.478526 2758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:35.478596 2758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:35.482477 2758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:35.482532 2758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:35.482615 2758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:35.487149 2758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:35.488158 2758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:35.489480 2758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:35.498734 2763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.498729 2765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.498730 2768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.499054 2758 server_base.cc:1034] running on GCE node
I20260809 02:01:35.499620 2758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:35.500243 2758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:35.501410 2758 hybrid_clock.cc:648] HybridClock initialized: now 1786240895501388 us; error 31 us; skew 500 ppm
I20260809 02:01:35.503216 2758 webserver.cc:460] Webserver started at http://127.14.175.193:41349/ using document root <none> and password file <none>
I20260809 02:01:35.503816 2758 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:35.503880 2758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:35.504040 2758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:35.506088 2758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "71ceaa4e99974480954126e28aa1ced7"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "87a4e66ec594d4a6c95fe9181dcdca03"
server_key_iv: "1c9cda4d36a0678289270e6faa550613"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.506788 2758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "71ceaa4e99974480954126e28aa1ced7"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "87a4e66ec594d4a6c95fe9181dcdca03"
server_key_iv: "1c9cda4d36a0678289270e6faa550613"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.510437 2758 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260809 02:01:35.512966 2774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.514221 2758 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:35.514338 2758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "71ceaa4e99974480954126e28aa1ced7"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "87a4e66ec594d4a6c95fe9181dcdca03"
server_key_iv: "1c9cda4d36a0678289270e6faa550613"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.514443 2758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:35.530354 2758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:35.531044 2758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:35.531231 2758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:35.531805 2758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:35.532716 2758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:35.532770 2758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.532835 2758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:35.532866 2758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.542193 2758 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:34989
I20260809 02:01:35.542244 2895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:34989 every 8 connection(s)
I20260809 02:01:35.543088 2758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:35.544947 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2758
I20260809 02:01:35.545082 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:35.545382 15039 external_mini_cluster.cc:1428] Setting key ad8ecc44efbefe8ce375c33237e7e029
I20260809 02:01:35.547609 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--builtin_ntp_servers=127.14.175.212:43337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:35.553947 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.544789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:49927 (local address 127.14.175.254:37447)
0809 02:01:35.544949 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.544954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.546161 (+ 1207us) server_negotiation.cc:407] Connection header received
0809 02:01:35.547911 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.547914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.547958 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.548033 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:35.549143 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.549670 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.551422 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.551866 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.551992 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.553351 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:35.553358 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:35.553365 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:35.553385 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:35.553414 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:35.553426 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:35.553532 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.553656 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.553732 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:01:35.554678 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.545273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37447 (local address 127.14.175.193:49927)
0809 02:01:35.545992 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.546043 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.547648 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.548197 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.548209 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.548324 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:35.548988 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.549009 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.549815 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.549822 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.551223 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.551237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.552091 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.552098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.552407 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.553091 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:35.553093 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:35.553130 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:35.553189 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:35.553520 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:35.553526 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:35.553531 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.553621 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.553861 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":151,"threads_started":1}
I20260809 02:01:35.556126 2896 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37447
I20260809 02:01:35.556362 2896 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:35.556849 2896 heartbeater.cc:511] Master 127.14.175.254:37447 requested a full tablet report, sending...
I20260809 02:01:35.558497 2694 ts_manager.cc:194] Registered new tserver with Master: 71ceaa4e99974480954126e28aa1ced7 (127.14.175.193:34989)
I20260809 02:01:35.560271 2694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.193:49927
W20260809 02:01:35.659754 2899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:35.659976 2899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:35.660012 2899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:35.663867 2899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:35.663910 2899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:35.663960 2899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:35.668478 2899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:35.669365 2899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:35.670675 2899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:35.679986 2904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.680022 2906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.680070 2899 server_base.cc:1034] running on GCE node
W20260809 02:01:35.680012 2908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.680634 2899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:35.681264 2899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:35.682451 2899 hybrid_clock.cc:648] HybridClock initialized: now 1786240895682440 us; error 27 us; skew 500 ppm
I20260809 02:01:35.684221 2899 webserver.cc:460] Webserver started at http://127.14.175.194:42551/ using document root <none> and password file <none>
I20260809 02:01:35.684785 2899 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:35.684882 2899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:35.685112 2899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:35.687139 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "f6cd37b07f6247ebb0abf5ddaaba1977"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "0acc9c3e14ba253de1c821225b878bca"
server_key_iv: "29de349df46279218b4269537248f292"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.687719 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "f6cd37b07f6247ebb0abf5ddaaba1977"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "0acc9c3e14ba253de1c821225b878bca"
server_key_iv: "29de349df46279218b4269537248f292"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.691471 2899 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:01:35.693764 2914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.695006 2899 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:35.695138 2899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "f6cd37b07f6247ebb0abf5ddaaba1977"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "0acc9c3e14ba253de1c821225b878bca"
server_key_iv: "29de349df46279218b4269537248f292"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.695245 2899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:35.714320 2899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:35.715067 2899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:35.715260 2899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:35.715911 2899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:35.716887 2899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:35.716966 2899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.717031 2899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:35.717074 2899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.726445 2899 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:40733
I20260809 02:01:35.726486 3034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:40733 every 8 connection(s)
I20260809 02:01:35.727349 2899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:35.735209 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 2899
I20260809 02:01:35.735368 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:35.735734 15039 external_mini_cluster.cc:1428] Setting key 20e6b6143e900f17cbe20b0871ada1e0
I20260809 02:01:35.736536 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.729080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:56597 (local address 127.14.175.254:37447)
0809 02:01:35.729222 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.729231 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.730348 (+ 1117us) server_negotiation.cc:407] Connection header received
0809 02:01:35.731771 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.731775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.731835 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.731914 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:35.732774 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.733313 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.734467 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.734707 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.734837 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.736015 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:35.736019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:35.736021 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:35.736034 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:35.736063 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:35.736071 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:35.736152 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.736316 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.736382 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:01:35.737314 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.729435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37447 (local address 127.14.175.194:56597)
0809 02:01:35.730167 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.730207 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.731554 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.732080 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.732086 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.732166 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:35.732611 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.732624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.733448 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.733452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.734332 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.734341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.734880 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.734884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.735112 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.735724 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:35.735726 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:35.735763 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:35.735864 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:35.736153 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:35.736165 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:35.736175 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.736308 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.736567 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":127,"threads_started":1}
I20260809 02:01:35.737890 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--builtin_ntp_servers=127.14.175.212:43337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:35.738469 3035 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37447
I20260809 02:01:35.738708 3035 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:35.739307 3035 heartbeater.cc:511] Master 127.14.175.254:37447 requested a full tablet report, sending...
I20260809 02:01:35.740392 2694 ts_manager.cc:194] Registered new tserver with Master: f6cd37b07f6247ebb0abf5ddaaba1977 (127.14.175.194:40733)
I20260809 02:01:35.740955 2694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.194:56597
W20260809 02:01:35.849551 3038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:35.849771 3038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:35.849814 3038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:35.853771 3038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:35.853822 3038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:35.853921 3038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:35.858551 3038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:43337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:35.859560 3038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:35.860816 3038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:35.870106 3043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.870191 3038 server_base.cc:1034] running on GCE node
W20260809 02:01:35.870194 3044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:35.870107 3047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:35.870834 3038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:35.871454 3038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:35.872617 3038 hybrid_clock.cc:648] HybridClock initialized: now 1786240895872605 us; error 28 us; skew 500 ppm
I20260809 02:01:35.874348 3038 webserver.cc:460] Webserver started at http://127.14.175.195:39851/ using document root <none> and password file <none>
I20260809 02:01:35.874948 3038 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:35.875075 3038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:35.875308 3038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:35.877219 3038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "5100b05a6a0f4d04916f372f1b80e11d"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "e662682b10eceffffaa81f4393beaad1"
server_key_iv: "4f320247f9a8cb8c560fb32997b66668"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.877765 3038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "5100b05a6a0f4d04916f372f1b80e11d"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "e662682b10eceffffaa81f4393beaad1"
server_key_iv: "4f320247f9a8cb8c560fb32997b66668"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.881245 3038 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:01:35.883561 3056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.884680 3038 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:01:35.884816 3038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "5100b05a6a0f4d04916f372f1b80e11d"
format_stamp: "Formatted at 2026-08-09 02:01:35 on dist-test-slave-2w3w"
server_key: "e662682b10eceffffaa81f4393beaad1"
server_key_iv: "4f320247f9a8cb8c560fb32997b66668"
server_key_version: "encryptionkey@0"
I20260809 02:01:35.884924 3038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:35.910660 3038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:35.911379 3038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:35.911583 3038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:35.912241 3038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:35.913175 3038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:35.913246 3038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.913321 3038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:35.913374 3038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:35.922317 3038 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:36253
I20260809 02:01:35.922405 3175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:36253 every 8 connection(s)
I20260809 02:01:35.923267 3038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:35.925575 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3038
I20260809 02:01:35.925686 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:35.926036 15039 external_mini_cluster.cc:1428] Setting key cc4842013ac6c5d5d0823569b99480fb
I20260809 02:01:35.932735 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.925100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:49829 (local address 127.14.175.254:37447)
0809 02:01:35.925248 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.925253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.926767 (+ 1514us) server_negotiation.cc:407] Connection header received
0809 02:01:35.928169 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.928177 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.928221 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.928320 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:35.929164 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.929679 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.930796 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.931080 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.931161 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.932353 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:35.932355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:35.932357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:35.932368 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:35.932384 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:35.932391 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:35.932446 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.932568 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.932619 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:01:35.933564 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.925613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:37447 (local address 127.14.175.195:49829)
0809 02:01:35.926401 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.926457 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.927949 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.928459 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.928465 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.928546 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:35.929040 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.929053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.929783 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.929786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.930683 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.930701 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.931251 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.931254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.931419 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.932120 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:35.932122 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:35.932162 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:35.932222 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:35.932458 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:35.932463 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:35.932467 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.932553 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.932820 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":159,"threads_started":1}
I20260809 02:01:35.934688 3177 heartbeater.cc:347] Connected to a master server at 127.14.175.254:37447
I20260809 02:01:35.934979 3177 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:35.935497 3177 heartbeater.cc:511] Master 127.14.175.254:37447 requested a full tablet report, sending...
I20260809 02:01:35.936481 2694 ts_manager.cc:194] Registered new tserver with Master: 5100b05a6a0f4d04916f372f1b80e11d (127.14.175.195:36253)
I20260809 02:01:35.937048 2694 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.195:49829
I20260809 02:01:35.940092 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:35.945499 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.942003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60238 (local address 127.14.175.254:37447)
0809 02:01:35.942167 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.942173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.942302 (+ 129us) server_negotiation.cc:407] Connection header received
0809 02:01:35.942380 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.942382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.942419 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.942484 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:35.942705 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.943245 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.944024 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.944217 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.944289 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.945001 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:35.945004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:35.945006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:35.945016 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:35.945035 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:35.945042 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:35.945140 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.945266 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.945336 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 02:01:35.948186 2694 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:35.951154 2694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:35.965260 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.958930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34989 (local address 127.0.0.1:44978)
0809 02:01:35.959935 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.959984 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.960467 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.961083 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.961088 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.961107 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:35.961192 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.961199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962206 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.962212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.963818 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.963830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.964690 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.964798 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.964834 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.964965 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.965086 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":98,"thread_start_us":130,"threads_started":1}
I20260809 02:01:35.965489 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.959111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44978 (local address 127.14.175.193:34989)
0809 02:01:35.959567 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.959580 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.960079 (+ 499us) server_negotiation.cc:407] Connection header received
0809 02:01:35.960755 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.960763 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.960938 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.961095 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:35.961309 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962090 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.963949 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.964560 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964702 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.964899 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.965197 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.965307 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":134,"threads_started":1}
I20260809 02:01:35.965620 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.959204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:36253 (local address 127.0.0.1:51730)
0809 02:01:35.959939 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.959990 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.960143 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.960882 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.960886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.960904 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:35.961001 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.961014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962434 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.962437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.963986 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.963993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.965181 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.965185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.965286 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.965309 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.965381 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.965451 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":331,"thread_start_us":94,"threads_started":1}
I20260809 02:01:35.965852 3193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.959976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36246 (local address 127.14.175.194:40733)
0809 02:01:35.960744 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.960757 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.960778 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:01:35.960851 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.960855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.960998 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.961122 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:35.961503 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962568 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964026 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.964829 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964951 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.965109 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.965335 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.965658 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":124,"threads_started":1}
I20260809 02:01:35.966130 3191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.959220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51730 (local address 127.14.175.195:36253)
0809 02:01:35.959799 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:35.959811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:35.960279 (+ 468us) server_negotiation.cc:407] Connection header received
0809 02:01:35.960355 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:35.960358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:35.960567 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:35.960738 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:35.961162 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962315 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964092 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.964829 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964951 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.965109 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:35.965878 (+ 769us) server_negotiation.cc:299] Negotiation successful
0809 02:01:35.965979 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":147,"threads_started":1}
I20260809 02:01:35.966409 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:35.959783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40733 (local address 127.0.0.1:36246)
0809 02:01:35.960227 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:35.960241 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:35.960334 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:35.961257 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:35.961260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:35.961281 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:35.961370 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.961376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.962685 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.962693 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.963844 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:35.963853 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:35.964989 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:35.964992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:35.965079 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:35.965100 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:01:35.965183 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:01:35.965237 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":77,"thread_start_us":99,"threads_started":1}
I20260809 02:01:35.968537 2827 tablet_service.cc:1467] Processing CreateTablet for tablet 98cc2243ff994e748984bddac47762dd (DEFAULT_TABLE table=test-table [id=d29ba6e24e014e77b892b4076cca960d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:35.968981 3109 tablet_service.cc:1467] Processing CreateTablet for tablet 98cc2243ff994e748984bddac47762dd (DEFAULT_TABLE table=test-table [id=d29ba6e24e014e77b892b4076cca960d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:35.969534 2827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cc2243ff994e748984bddac47762dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:35.969421 2967 tablet_service.cc:1467] Processing CreateTablet for tablet 98cc2243ff994e748984bddac47762dd (DEFAULT_TABLE table=test-table [id=d29ba6e24e014e77b892b4076cca960d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:35.969997 3109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cc2243ff994e748984bddac47762dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:35.970432 2967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cc2243ff994e748984bddac47762dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:35.976464 3194 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Bootstrap starting.
I20260809 02:01:35.977206 3195 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Bootstrap starting.
I20260809 02:01:35.977597 3196 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Bootstrap starting.
I20260809 02:01:35.979319 3195 tablet_bootstrap.cc:654] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:35.979319 3194 tablet_bootstrap.cc:654] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:35.979400 3196 tablet_bootstrap.cc:654] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:35.980108 3196 log.cc:824] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:35.980173 3194 log.cc:824] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:35.980173 3195 log.cc:824] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:35.982178 3196 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: No bootstrap required, opened a new log
I20260809 02:01:35.982228 3195 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: No bootstrap required, opened a new log
I20260809 02:01:35.982389 3196 ts_tablet_manager.cc:1397] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:01:35.982434 3195 ts_tablet_manager.cc:1397] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:01:35.982761 3194 tablet_bootstrap.cc:492] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: No bootstrap required, opened a new log
I20260809 02:01:35.982998 3194 ts_tablet_manager.cc:1397] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:01:35.985626 3196 raft_consensus.cc:348] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.985872 3196 raft_consensus.cc:374] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:35.985948 3196 raft_consensus.cc:729] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd37b07f6247ebb0abf5ddaaba1977, State: Initialized, Role: FOLLOWER
I20260809 02:01:35.986420 3196 consensus_queue.cc:260] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.986763 3195 raft_consensus.cc:348] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.986763 3194 raft_consensus.cc:348] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.987035 3194 raft_consensus.cc:374] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:35.987097 3195 raft_consensus.cc:374] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:35.987104 3035 heartbeater.cc:503] Master 127.14.175.254:37447 was elected leader, sending a full tablet report...
I20260809 02:01:35.987130 3194 raft_consensus.cc:729] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ceaa4e99974480954126e28aa1ced7, State: Initialized, Role: FOLLOWER
I20260809 02:01:35.987197 3195 raft_consensus.cc:729] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5100b05a6a0f4d04916f372f1b80e11d, State: Initialized, Role: FOLLOWER
I20260809 02:01:35.987468 3196 ts_tablet_manager.cc:1428] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:01:35.987593 3194 consensus_queue.cc:260] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.987744 3195 consensus_queue.cc:260] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:35.988864 3194 ts_tablet_manager.cc:1428] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:01:35.988878 3195 ts_tablet_manager.cc:1428] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:01:35.989194 2896 heartbeater.cc:503] Master 127.14.175.254:37447 was elected leader, sending a full tablet report...
I20260809 02:01:35.989202 3177 heartbeater.cc:503] Master 127.14.175.254:37447 was elected leader, sending a full tablet report...
W20260809 02:01:36.044157 2897 tablet.cc:2369] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:36.082806 3200 raft_consensus.cc:482] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:36.083022 3200 raft_consensus.cc:504] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:36.084161 3200 leader_election.cc:288] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ceaa4e99974480954126e28aa1ced7 (127.14.175.193:34989), 5100b05a6a0f4d04916f372f1b80e11d (127.14.175.195:36253)
I20260809 02:01:36.089022 3191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.084672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:36727 (local address 127.14.175.195:36253)
0809 02:01:36.084796 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:36.084800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:36.085015 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:01:36.085094 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:36.085096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:36.085137 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:36.085237 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:36.085487 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.086206 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.087688 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.088296 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.088429 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:36.088479 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:36.088807 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:01:36.088888 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:01:36.089022 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.084465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:50569 (local address 127.14.175.193:34989)
0809 02:01:36.084612 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:36.084619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:36.084637 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:01:36.084717 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:36.084720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:36.084783 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:36.084890 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:36.085240 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.086036 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.087688 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.088296 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.088429 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:36.088479 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:36.088807 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:01:36.088888 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:01:36.089102 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.084343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34989 (local address 127.14.175.194:50569)
0809 02:01:36.084470 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:36.084490 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:36.084588 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:36.084934 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:36.084939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:36.084965 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:36.085116 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:36.085123 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.086148 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.086150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:36.087552 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:36.087558 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.088433 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.088437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:36.088628 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:36.088689 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 02:01:36.088767 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:01:36.088919 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":175,"spinlock_wait_cycles":1792}
I20260809 02:01:36.089136 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.084462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:36253 (local address 127.14.175.194:36727)
0809 02:01:36.084889 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:36.084906 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:36.085012 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:36.085260 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:36.085263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:36.085278 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:36.085373 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:36.085377 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.086299 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.086301 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:36.087546 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:36.087558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.088433 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.088437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:36.088625 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:36.088687 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 02:01:36.088767 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:01:36.088942 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":97,"thread_start_us":121,"threads_started":1}
I20260809 02:01:36.089869 3129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cc2243ff994e748984bddac47762dd" candidate_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5100b05a6a0f4d04916f372f1b80e11d" is_pre_election: true
I20260809 02:01:36.090217 3129 raft_consensus.cc:2454] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6cd37b07f6247ebb0abf5ddaaba1977 in term 0.
I20260809 02:01:36.090298 2847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cc2243ff994e748984bddac47762dd" candidate_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ceaa4e99974480954126e28aa1ced7" is_pre_election: true
I20260809 02:01:36.090590 2847 raft_consensus.cc:2454] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6cd37b07f6247ebb0abf5ddaaba1977 in term 0.
I20260809 02:01:36.090777 2919 leader_election.cc:302] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5100b05a6a0f4d04916f372f1b80e11d, f6cd37b07f6247ebb0abf5ddaaba1977; no voters:
I20260809 02:01:36.091104 3200 raft_consensus.cc:2781] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:36.091205 3200 raft_consensus.cc:482] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:36.091250 3200 raft_consensus.cc:3037] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:36.092304 3200 raft_consensus.cc:504] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:36.092657 3200 leader_election.cc:288] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [CANDIDATE]: Term 1 election: Requested vote from peers 71ceaa4e99974480954126e28aa1ced7 (127.14.175.193:34989), 5100b05a6a0f4d04916f372f1b80e11d (127.14.175.195:36253)
I20260809 02:01:36.093027 2847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cc2243ff994e748984bddac47762dd" candidate_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ceaa4e99974480954126e28aa1ced7"
I20260809 02:01:36.093039 3129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cc2243ff994e748984bddac47762dd" candidate_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5100b05a6a0f4d04916f372f1b80e11d"
I20260809 02:01:36.093158 3129 raft_consensus.cc:3037] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:36.093158 2847 raft_consensus.cc:3037] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:36.094442 3129 raft_consensus.cc:2454] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6cd37b07f6247ebb0abf5ddaaba1977 in term 1.
I20260809 02:01:36.094442 2847 raft_consensus.cc:2454] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6cd37b07f6247ebb0abf5ddaaba1977 in term 1.
I20260809 02:01:36.094791 2917 leader_election.cc:302] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ceaa4e99974480954126e28aa1ced7, f6cd37b07f6247ebb0abf5ddaaba1977; no voters:
I20260809 02:01:36.095041 3200 raft_consensus.cc:2781] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:36.095280 3200 raft_consensus.cc:686] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 1 LEADER]: Becoming Leader. State: Replica: f6cd37b07f6247ebb0abf5ddaaba1977, State: Running, Role: LEADER
I20260809 02:01:36.095608 3200 consensus_queue.cc:237] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } }
I20260809 02:01:36.098542 2694 catalog_manager.cc:5495] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6cd37b07f6247ebb0abf5ddaaba1977 (127.14.175.194). New cstate: current_term: 1 leader_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cd37b07f6247ebb0abf5ddaaba1977" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40733 } health_report { overall_health: HEALTHY } } }
I20260809 02:01:36.118716 3193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.114946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36262 (local address 127.14.175.194:40733)
0809 02:01:36.115105 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:36.115110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:36.115125 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:01:36.115255 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:36.115257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:36.115311 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:36.115454 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:36.115741 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.116253 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.117155 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:36.117377 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:36.117488 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:36.117897 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:36.118359 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:36.118483 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:36.118574 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 02:01:36.118608 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:01:36.124352 3129 raft_consensus.cc:1261] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 1 FOLLOWER]: Refusing update from remote peer f6cd37b07f6247ebb0abf5ddaaba1977: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:36.124363 2847 raft_consensus.cc:1261] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 1 FOLLOWER]: Refusing update from remote peer f6cd37b07f6247ebb0abf5ddaaba1977: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:36.125031 3200 consensus_queue.cc:1035] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5100b05a6a0f4d04916f372f1b80e11d" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:36.125234 3204 consensus_queue.cc:1035] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ceaa4e99974480954126e28aa1ced7" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 34989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:36.132587 3210 mvcc.cc:205] Tried to move back new op lower bound from 7316442710518161408 to 7316442710409961472. Current Snapshot: MvccSnapshot[applied={T|T < 7316442710518161408}]
I20260809 02:01:36.133172 3211 mvcc.cc:205] Tried to move back new op lower bound from 7316442710518161408 to 7316442710409961472. Current Snapshot: MvccSnapshot[applied={T|T < 7316442710518161408}]
I20260809 02:01:36.141279 2693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:36.141425 2693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:36.143785 2693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 30ec8555053c4d3c8b8010b226cbf28c: Sending DeleteTablet for 3 replicas of tablet 98cc2243ff994e748984bddac47762dd
I20260809 02:01:36.144501 2827 tablet_service.cc:1514] Processing DeleteTablet for tablet 98cc2243ff994e748984bddac47762dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:36 UTC) from {username='slave'} at 127.0.0.1:44978
I20260809 02:01:36.144582 3109 tablet_service.cc:1514] Processing DeleteTablet for tablet 98cc2243ff994e748984bddac47762dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:36 UTC) from {username='slave'} at 127.0.0.1:51730
I20260809 02:01:36.144686 2967 tablet_service.cc:1514] Processing DeleteTablet for tablet 98cc2243ff994e748984bddac47762dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:36 UTC) from {username='slave'} at 127.0.0.1:36246
I20260809 02:01:36.145038 3220 tablet_replica.cc:330] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7: stopping tablet replica
I20260809 02:01:36.145354 3220 raft_consensus.cc:2229] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:36.145418 3221 tablet_replica.cc:330] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: stopping tablet replica
I20260809 02:01:36.145550 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2758
I20260809 02:01:36.145663 3221 raft_consensus.cc:2229] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:36.145669 3220 raft_consensus.cc:2258] T 98cc2243ff994e748984bddac47762dd P 71ceaa4e99974480954126e28aa1ced7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:36.147228 3222 tablet_replica.cc:330] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: stopping tablet replica
I20260809 02:01:36.147495 3222 raft_consensus.cc:2229] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:36.147827 3222 raft_consensus.cc:2258] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:36.148033 3221 raft_consensus.cc:2258] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:36.149400 3221 ts_tablet_manager.cc:1905] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:36.151779 3221 ts_tablet_manager.cc:1918] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:36.151896 3221 log.cc:1196] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/98cc2243ff994e748984bddac47762dd
I20260809 02:01:36.152184 3221 ts_tablet_manager.cc:1939] T 98cc2243ff994e748984bddac47762dd P 5100b05a6a0f4d04916f372f1b80e11d: Deleting consensus metadata
I20260809 02:01:36.153272 2681 catalog_manager.cc:4841] TS 5100b05a6a0f4d04916f372f1b80e11d (127.14.175.195:36253): tablet 98cc2243ff994e748984bddac47762dd (table test-table [id=d29ba6e24e014e77b892b4076cca960d]) successfully deleted
I20260809 02:01:36.153975 3222 ts_tablet_manager.cc:1905] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:36.156087 3222 ts_tablet_manager.cc:1918] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:36.156203 3222 log.cc:1196] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/98cc2243ff994e748984bddac47762dd
I20260809 02:01:36.156488 3222 ts_tablet_manager.cc:1939] T 98cc2243ff994e748984bddac47762dd P f6cd37b07f6247ebb0abf5ddaaba1977: Deleting consensus metadata
W20260809 02:01:36.156916 2679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:34989 (error 108)
I20260809 02:01:36.157155 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2899
I20260809 02:01:36.159204 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.158729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:34989 (local address 127.0.0.1:44984)
0809 02:01:36.159014 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:36.159101 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260809 02:01:36.159442 2679 catalog_manager.cc:4584] TS 71ceaa4e99974480954126e28aa1ced7 (127.14.175.193:34989): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 98cc2243ff994e748984bddac47762dd: Network error: Client connection negotiation failed: client connection to 127.14.175.193:34989: connect: Connection refused (error 111)
I20260809 02:01:36.164286 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3038
I20260809 02:01:36.166011 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:36.164428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40733 (local address 127.0.0.1:36270)
0809 02:01:36.165853 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:36.165917 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.194:40733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1328}
I20260809 02:01:36.171648 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 2663
2026-08-09T02:01:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1080 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:36 dist-test-slave-2w3w krb5kdc[3226](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:36 dist-test-slave-2w3w krb5kdc[3226](info): set up 2 sockets
Aug 09 02:01:36 dist-test-slave-2w3w krb5kdc[3226](info): commencing operation
krb5kdc: starting...
W20260809 02:01:37.251979 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:01:37.373644 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:42819
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:42819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:37.479607 3240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:37.479856 3240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:37.479897 3240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:37.483790 3240 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:37.483846 3240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:37.483865 3240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:37.483881 3240 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:37.483896 3240 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:37.488870 3240 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:42819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:42819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:37.489799 3240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:37.490700 3240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:37.498874 3246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:37.499025 3245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:37.499061 3240 server_base.cc:1034] running on GCE node
W20260809 02:01:37.498878 3249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:37.499750 3240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:37.500795 3240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:37.501989 3240 hybrid_clock.cc:648] HybridClock initialized: now 1786240897501971 us; error 43 us; skew 500 ppm
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:37.504771 3240 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:37.505581 3240 webserver.cc:460] Webserver started at http://127.14.175.254:44295/ using document root <none> and password file <none>
I20260809 02:01:37.506130 3240 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:37.506219 3240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:37.506448 3240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:37.508489 3240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "72100a39a8364cf0ac126be15ababf38"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "7a0b8489b3bacfe2b2533e4da83d7a5f"
server_key_iv: "e786b38c34a03da5d1715ea89d7869ec"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.509037 3240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "72100a39a8364cf0ac126be15ababf38"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "7a0b8489b3bacfe2b2533e4da83d7a5f"
server_key_iv: "e786b38c34a03da5d1715ea89d7869ec"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.512579 3240 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:01:37.514782 3256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:37.516022 3240 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:01:37.516151 3240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "72100a39a8364cf0ac126be15ababf38"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "7a0b8489b3bacfe2b2533e4da83d7a5f"
server_key_iv: "e786b38c34a03da5d1715ea89d7869ec"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.516255 3240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:37.525599 3240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:37.528625 3240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:37.528820 3240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:37.535449 3240 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:42819
I20260809 02:01:37.535526 3308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:42819 every 8 connection(s)
I20260809 02:01:37.536332 3240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:37.538902 3309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:37.539116 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3240
I20260809 02:01:37.539258 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:37.539578 15039 external_mini_cluster.cc:1428] Setting key 5021aea39990e5c89879146782175075
I20260809 02:01:37.546000 3309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: Bootstrap starting.
I20260809 02:01:37.548522 3309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: Neither blocks nor log segments found. Creating new log.
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:37.549419 3309 log.cc:824] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:37.551330 3309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: No bootstrap required, opened a new log
I20260809 02:01:37.554325 3314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:37.540822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52388 (local address 127.14.175.254:42819)
0809 02:01:37.541215 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:37.541232 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:37.541272 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:01:37.542367 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:37.542392 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:37.542786 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:37.543150 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:37.543879 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.545372 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.546224 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.546868 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.547067 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:37.549759 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:37.549763 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:37.549775 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:37.549800 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:37.551668 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:37.552153 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:37.552157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:37.552161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:37.552267 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:37.552559 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:37.552561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:37.552562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:37.552917 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:37.553067 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:37.553362 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 02:01:37.553624 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":127,"threads_started":1}
I20260809 02:01:37.555287 3309 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } }
I20260809 02:01:37.555486 3309 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:37.555559 3309 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72100a39a8364cf0ac126be15ababf38, State: Initialized, Role: FOLLOWER
I20260809 02:01:37.556005 3309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } }
I20260809 02:01:37.556124 3309 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:37.556201 3309 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:37.556301 3309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:37.557147 3309 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } }
I20260809 02:01:37.557459 3309 leader_election.cc:302] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72100a39a8364cf0ac126be15ababf38; no voters:
I20260809 02:01:37.557744 3309 leader_election.cc:288] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:37.557888 3316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:37.558210 3316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [term 1 LEADER]: Becoming Leader. State: Replica: 72100a39a8364cf0ac126be15ababf38, State: Running, Role: LEADER
I20260809 02:01:37.558497 3316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } }
I20260809 02:01:37.558923 3309 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:37.560287 3317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72100a39a8364cf0ac126be15ababf38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } } }
I20260809 02:01:37.560281 3318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72100a39a8364cf0ac126be15ababf38. Latest consensus state: current_term: 1 leader_uuid: "72100a39a8364cf0ac126be15ababf38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72100a39a8364cf0ac126be15ababf38" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 42819 } } }
I20260809 02:01:37.560438 3317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:37.560438 3318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38 [sys.catalog]: This master's current role is: LEADER
W20260809 02:01:37.563527 3331 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:01:37.563589 3331 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:01:37.563668 3327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:37.564504 3327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:37.569533 3327 catalog_manager.cc:1347] Generated new cluster ID: c4668f959bdf44dc934237423f5f1462
I20260809 02:01:37.569614 3327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:37.577687 3327 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:37.578528 3327 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:37.583201 3327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: Generated new TSK 0
I20260809 02:01:37.583817 3327 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
Entry for principal kudu/127.14.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab.
I20260809 02:01:37.615569 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:37.724100 3337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:37.724335 3337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:37.724381 3337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:37.728343 3337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:37.728389 3337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:37.728442 3337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:37.733553 3337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.193.keytab
--principal=kudu/127.14.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:37.734561 3337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:37.735560 3337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:37.744778 3343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:37.744803 3345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:37.744829 3342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:37.745105 3337 server_base.cc:1034] running on GCE node
I20260809 02:01:37.745481 3337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:37.746068 3337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:37.747246 3337 hybrid_clock.cc:648] HybridClock initialized: now 1786240897747224 us; error 34 us; skew 500 ppm
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:37.749910 3337 init.cc:377] Logged in from keytab as kudu/127.14.175.193@KRBTEST.COM (short username kudu)
I20260809 02:01:37.750701 3337 webserver.cc:460] Webserver started at http://127.14.175.193:39125/ using document root <none> and password file <none>
I20260809 02:01:37.751246 3337 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:37.751307 3337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:37.751461 3337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:37.753311 3337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "c495b5f7487a447d8b7dfe9a15b115cd"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "91a4caa6ff58ec331e5246f0c073dfe4"
server_key_iv: "65e4e629c7b1e24a6f2f2a812d5de35c"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.753800 3337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "c495b5f7487a447d8b7dfe9a15b115cd"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "91a4caa6ff58ec331e5246f0c073dfe4"
server_key_iv: "65e4e629c7b1e24a6f2f2a812d5de35c"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.757226 3337 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:01:37.759567 3353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:37.760789 3337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:37.760907 3337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "c495b5f7487a447d8b7dfe9a15b115cd"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "91a4caa6ff58ec331e5246f0c073dfe4"
server_key_iv: "65e4e629c7b1e24a6f2f2a812d5de35c"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.761013 3337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:37.779762 3337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:37.782435 3337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:37.782567 3337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:37.783119 3337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:37.783818 3337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:37.783864 3337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:37.783900 3337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:37.783922 3337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:37.792778 3337 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:41061
I20260809 02:01:37.792802 3477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:41061 every 8 connection(s)
I20260809 02:01:37.793596 3337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:37.801879 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3337
I20260809 02:01:37.802052 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:37.802366 15039 external_mini_cluster.cc:1428] Setting key bb8ee08cd572c61934786cdaea59f5ce
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.193@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:37.807051 3314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:37.795348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:50671 (local address 127.14.175.254:42819)
0809 02:01:37.795528 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:37.795534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:37.796316 (+ 782us) server_negotiation.cc:407] Connection header received
0809 02:01:37.797566 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:37.797569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:37.797617 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:37.797696 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:37.798805 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.799433 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.800574 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.800874 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.800968 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:37.803474 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:37.803478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:37.803480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:37.803504 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:37.805028 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:37.805528 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:37.805533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:37.805535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:37.805617 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:37.805956 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:37.805962 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:37.805963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:37.806148 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:37.806256 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:37.806719 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 02:01:37.806842 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:01:37.807771 3480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:37.795729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:42819 (local address 127.14.175.193:50671)
0809 02:01:37.796169 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:37.796211 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:37.797367 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:37.797843 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:37.797849 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:37.798176 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:37.798610 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:37.798621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.799547 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.799549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:37.800414 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:37.800440 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:37.801013 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:37.801016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:37.801148 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:37.801655 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:37.801670 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:37.803320 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:37.805148 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:37.805154 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:37.805166 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:37.805415 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:37.805709 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:37.805713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:37.805715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:37.805858 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:37.806253 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:37.806259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:37.806494 (+ 235us) client_negotiation.cc:769] Sending connection context
0809 02:01:37.806678 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 02:01:37.806970 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260809 02:01:37.808959 3478 heartbeater.cc:347] Connected to a master server at 127.14.175.254:42819
I20260809 02:01:37.809207 3478 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:37.809803 3478 heartbeater.cc:511] Master 127.14.175.254:42819 requested a full tablet report, sending...
I20260809 02:01:37.811553 3273 ts_manager.cc:194] Registered new tserver with Master: c495b5f7487a447d8b7dfe9a15b115cd (127.14.175.193:41061)
WARNING: no policy specified for kudu/127.14.175.194@KRBTEST.COM; defaulting to no policy
I20260809 02:01:37.813215 3273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.193@KRBTEST.COM'} at 127.14.175.193:50671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
Entry for principal kudu/127.14.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab.
I20260809 02:01:37.831096 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:37.939256 3483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:37.939496 3483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:37.939555 3483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:37.943951 3483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:37.944015 3483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:37.944074 3483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:37.949390 3483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.194.keytab
--principal=kudu/127.14.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:37.950350 3483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:37.951396 3483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:01:37.960772 3483 server_base.cc:1034] running on GCE node
W20260809 02:01:37.960705 3489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:37.960763 3488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:37.960705 3491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:37.961453 3483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:37.962025 3483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:37.963179 3483 hybrid_clock.cc:648] HybridClock initialized: now 1786240897963157 us; error 37 us; skew 500 ppm
Aug 09 02:01:37 dist-test-slave-2w3w krb5kdc[3226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:37.966014 3483 init.cc:377] Logged in from keytab as kudu/127.14.175.194@KRBTEST.COM (short username kudu)
I20260809 02:01:37.966814 3483 webserver.cc:460] Webserver started at http://127.14.175.194:41129/ using document root <none> and password file <none>
I20260809 02:01:37.967392 3483 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:37.967453 3483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:37.967615 3483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:37.969811 3483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "8323c20016b64dfa9827c2313b724d1f"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "c0313b8d626a6ad601e26c6071d3b7c5"
server_key_iv: "89a967ce2c581600e8d6a99c07662506"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.970580 3483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "8323c20016b64dfa9827c2313b724d1f"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "c0313b8d626a6ad601e26c6071d3b7c5"
server_key_iv: "89a967ce2c581600e8d6a99c07662506"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.974247 3483 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:01:37.976737 3498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:37.977996 3483 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:37.978127 3483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "8323c20016b64dfa9827c2313b724d1f"
format_stamp: "Formatted at 2026-08-09 02:01:37 on dist-test-slave-2w3w"
server_key: "c0313b8d626a6ad601e26c6071d3b7c5"
server_key_iv: "89a967ce2c581600e8d6a99c07662506"
server_key_version: "encryptionkey@0"
I20260809 02:01:37.978235 3483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:37.996147 3483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:37.999456 3483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:37.999660 3483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:38.000248 3483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:38.001065 3483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:38.001133 3483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.001205 3483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:38.001248 3483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.010057 3483 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:33469
I20260809 02:01:38.010082 3619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:33469 every 8 connection(s)
I20260809 02:01:38.010905 3483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:38.018069 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3483
I20260809 02:01:38.018224 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:38.018566 15039 external_mini_cluster.cc:1428] Setting key ea1b11a7484040fc2bc8464a5bf99def
Aug 09 02:01:38 dist-test-slave-2w3w krb5kdc[3226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.194@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:38.026135 3314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.012829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:55477 (local address 127.14.175.254:42819)
0809 02:01:38.012978 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.012982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.013756 (+ 774us) server_negotiation.cc:407] Connection header received
0809 02:01:38.015174 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.015178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.015238 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.015349 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:38.016482 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.017103 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.018553 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.018821 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.018908 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.022076 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:38.022079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:38.022081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:38.022104 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:38.023861 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.024509 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.024511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.024512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.024584 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.024979 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.024981 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.024982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.025142 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:38.025216 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.025903 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.026011 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:01:38.027406 3622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.013196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:42819 (local address 127.14.175.194:55477)
0809 02:01:38.013611 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.013653 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.014920 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.015517 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.015523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.015871 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:38.016336 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.016349 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.017236 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.017244 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.018426 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.018439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.019001 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.019007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.019210 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.019936 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:38.019956 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:38.021914 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:38.023988 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:38.023997 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:38.024014 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:38.024403 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:38.024672 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:38.024678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:38.024683 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:38.024877 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:38.025258 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:38.025267 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:38.025623 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.025850 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.026216 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":101,"threads_started":1}
I20260809 02:01:38.028617 3620 heartbeater.cc:347] Connected to a master server at 127.14.175.254:42819
I20260809 02:01:38.028847 3620 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:38.029381 3620 heartbeater.cc:511] Master 127.14.175.254:42819 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.175.195@KRBTEST.COM; defaulting to no policy
I20260809 02:01:38.030560 3273 ts_manager.cc:194] Registered new tserver with Master: 8323c20016b64dfa9827c2313b724d1f (127.14.175.194:33469)
I20260809 02:01:38.031237 3273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.194@KRBTEST.COM'} at 127.14.175.194:55477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
Entry for principal kudu/127.14.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab.
I20260809 02:01:38.050236 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:38.160493 3625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:38.160728 3625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:38.160807 3625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:38.164878 3625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:38.164929 3625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:38.165026 3625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:38.170138 3625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.195.keytab
--principal=kudu/127.14.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:42819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:38.171139 3625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:38.172122 3625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:38.181504 3632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:38.181510 3631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:38.181592 3625 server_base.cc:1034] running on GCE node
W20260809 02:01:38.181514 3634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:38.182118 3625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:38.182716 3625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:38.183903 3625 hybrid_clock.cc:648] HybridClock initialized: now 1786240898183878 us; error 37 us; skew 500 ppm
Aug 09 02:01:38 dist-test-slave-2w3w krb5kdc[3226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240898, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:38.186704 3625 init.cc:377] Logged in from keytab as kudu/127.14.175.195@KRBTEST.COM (short username kudu)
I20260809 02:01:38.187604 3625 webserver.cc:460] Webserver started at http://127.14.175.195:33791/ using document root <none> and password file <none>
I20260809 02:01:38.188181 3625 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:38.188273 3625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:38.188483 3625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:38.190439 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f1b2c3e7a254188b3c3145eef8db8147"
server_key_iv: "79c44ca0fe4f8823dc07cd692ff9fd61"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.191080 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f1b2c3e7a254188b3c3145eef8db8147"
server_key_iv: "79c44ca0fe4f8823dc07cd692ff9fd61"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.194612 3625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:01:38.197007 3641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.198154 3625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:38.198287 3625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f1b2c3e7a254188b3c3145eef8db8147"
server_key_iv: "79c44ca0fe4f8823dc07cd692ff9fd61"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.198391 3625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:38.209525 3625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:38.212255 3625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:38.212448 3625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:38.213008 3625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:38.213789 3625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:38.213858 3625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.213920 3625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:38.213969 3625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.222985 3625 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:45053
I20260809 02:01:38.223052 3767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:45053 every 8 connection(s)
I20260809 02:01:38.223830 3625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:38.227039 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3625
I20260809 02:01:38.227201 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:38.227504 15039 external_mini_cluster.cc:1428] Setting key db98e9cd887e32a1161b6fc4d2f1ab6d
Aug 09 02:01:38 dist-test-slave-2w3w krb5kdc[3226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240898, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.195@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:38.237268 3314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.225465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:33373 (local address 127.14.175.254:42819)
0809 02:01:38.225638 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.225643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.226429 (+ 786us) server_negotiation.cc:407] Connection header received
0809 02:01:38.228035 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.228038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.228092 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.228194 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:38.229731 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.230279 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.231393 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.231623 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.231704 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.234078 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:38.234080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:38.234082 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:38.234103 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:38.235427 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.235883 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.235885 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.235887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.235961 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.236313 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.236316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.236317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.236510 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:38.236601 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.237044 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.237145 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 02:01:38.238031 3770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.225844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:42819 (local address 127.14.175.195:33373)
0809 02:01:38.226274 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.226318 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.227749 (+ 1431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.228410 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.228421 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.228888 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:38.229577 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.229597 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.230398 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.230400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.231278 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.231287 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.231750 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.231752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.231900 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.232512 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:01:38.232528 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:38.233940 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:38.235531 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:38.235535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:38.235545 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:38.235786 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:38.236040 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:01:38.236042 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:01:38.236043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:01:38.236169 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:01:38.236612 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:38.236617 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:38.236832 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.236988 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.237220 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":117,"threads_started":1}
I20260809 02:01:38.239157 3768 heartbeater.cc:347] Connected to a master server at 127.14.175.254:42819
I20260809 02:01:38.239353 3768 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:38.239769 3768 heartbeater.cc:511] Master 127.14.175.254:42819 requested a full tablet report, sending...
I20260809 02:01:38.241030 3273 ts_manager.cc:194] Registered new tserver with Master: 72e83a74501b4a3f8dbf986cb7bc4c8c (127.14.175.195:45053)
I20260809 02:01:38.241652 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:38.241782 3273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.175.195@KRBTEST.COM'} at 127.14.175.195:33373
I20260809 02:01:38.250418 3314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.243793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52402 (local address 127.14.175.254:42819)
0809 02:01:38.243905 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.243909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.244059 (+ 150us) server_negotiation.cc:407] Connection header received
0809 02:01:38.244138 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.244140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.244173 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.244237 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:38.244943 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.245440 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.246255 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.246451 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.246537 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.247851 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:38.247853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:38.247855 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:38.247874 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:38.249037 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.249419 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.249421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.249422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.249490 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:38.249730 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:38.249731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:38.249732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:38.249920 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:38.250020 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.250220 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.250306 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:01:38.253048 3273 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:38.256094 3273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:38.270397 3784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.264565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36182 (local address 127.14.175.193:41061)
0809 02:01:38.265485 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.265501 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.265526 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:01:38.265605 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.265612 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.265810 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.265964 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:38.266468 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.267659 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269101 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.269677 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269820 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.269957 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.270150 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.270246 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":72,"threads_started":1}
I20260809 02:01:38.270391 3782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.264312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:41061 (local address 127.0.0.1:36182)
0809 02:01:38.265223 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.265236 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.265318 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.266142 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.266145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.266163 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:38.266334 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.266343 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.267813 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.267817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.268978 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.268988 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.269808 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.269942 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.269984 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.270116 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.270236 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":173,"spinlock_wait_cycles":1280,"thread_start_us":102,"threads_started":1}
I20260809 02:01:38.270606 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.264312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45053 (local address 127.0.0.1:57298)
0809 02:01:38.265055 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.265109 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.265237 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.266128 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.266134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.266155 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:38.266282 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.266287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.267468 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.267475 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.268874 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.268885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.270201 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.270205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.270291 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.270311 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.270384 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.270454 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":59,"thread_start_us":59,"threads_started":1}
I20260809 02:01:38.270793 3785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.265025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:33469 (local address 127.0.0.1:45896)
0809 02:01:38.265925 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.265938 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.266027 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.266441 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.266444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.266463 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:38.266540 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.266545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.268288 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.268292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.269197 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.269207 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.270403 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.270406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.270483 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.270502 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.270580 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.270654 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":4,"thread_start_us":94,"threads_started":1}
I20260809 02:01:38.271253 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.265460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45896 (local address 127.14.175.194:33469)
0809 02:01:38.265779 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.265791 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.266030 (+ 239us) server_negotiation.cc:407] Connection header received
0809 02:01:38.266133 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.266137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.266304 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.266448 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:38.266635 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.268140 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269338 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.270122 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.270233 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.270343 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.270950 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.271105 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":123,"threads_started":1}
I20260809 02:01:38.271508 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.264472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57298 (local address 127.14.175.195:45053)
0809 02:01:38.265072 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.265089 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.265405 (+ 316us) server_negotiation.cc:407] Connection header received
0809 02:01:38.265543 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.265553 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.265776 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.265938 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:38.266421 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.267323 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269022 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.269864 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.269992 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.270128 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.271240 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.271368 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":127,"threads_started":1}
I20260809 02:01:38.273866 3403 tablet_service.cc:1467] Processing CreateTablet for tablet 685031a008ef44829ed744d5ae8ba41a (DEFAULT_TABLE table=test-table [id=b4134578d83b4b1183a8029909e6488c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:38.273866 3550 tablet_service.cc:1467] Processing CreateTablet for tablet 685031a008ef44829ed744d5ae8ba41a (DEFAULT_TABLE table=test-table [id=b4134578d83b4b1183a8029909e6488c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:38.275059 3550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 685031a008ef44829ed744d5ae8ba41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:38.275127 3403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 685031a008ef44829ed744d5ae8ba41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:38.276237 3695 tablet_service.cc:1467] Processing CreateTablet for tablet 685031a008ef44829ed744d5ae8ba41a (DEFAULT_TABLE table=test-table [id=b4134578d83b4b1183a8029909e6488c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:38.276998 3695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 685031a008ef44829ed744d5ae8ba41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:38.282799 3787 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Bootstrap starting.
I20260809 02:01:38.282977 3788 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Bootstrap starting.
I20260809 02:01:38.283644 3789 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Bootstrap starting.
I20260809 02:01:38.285403 3787 tablet_bootstrap.cc:654] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:38.285691 3789 tablet_bootstrap.cc:654] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:38.287129 3789 log.cc:824] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:38.287633 3788 tablet_bootstrap.cc:654] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:38.288224 3787 log.cc:824] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:38.288839 3788 log.cc:824] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:38.289402 3789 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: No bootstrap required, opened a new log
I20260809 02:01:38.289611 3789 ts_tablet_manager.cc:1397] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 02:01:38.290051 3787 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: No bootstrap required, opened a new log
I20260809 02:01:38.290253 3787 ts_tablet_manager.cc:1397] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 02:01:38.290831 3788 tablet_bootstrap.cc:492] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: No bootstrap required, opened a new log
I20260809 02:01:38.291033 3788 ts_tablet_manager.cc:1397] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 02:01:38.293512 3787 raft_consensus.cc:348] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.293555 3789 raft_consensus.cc:348] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.293792 3789 raft_consensus.cc:374] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:38.293792 3787 raft_consensus.cc:374] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:38.293853 3787 raft_consensus.cc:729] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c495b5f7487a447d8b7dfe9a15b115cd, State: Initialized, Role: FOLLOWER
I20260809 02:01:38.293881 3789 raft_consensus.cc:729] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e83a74501b4a3f8dbf986cb7bc4c8c, State: Initialized, Role: FOLLOWER
I20260809 02:01:38.294353 3787 consensus_queue.cc:260] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.294342 3789 consensus_queue.cc:260] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.294898 3788 raft_consensus.cc:348] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.295142 3768 heartbeater.cc:503] Master 127.14.175.254:42819 was elected leader, sending a full tablet report...
I20260809 02:01:38.295264 3788 raft_consensus.cc:374] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:38.295368 3788 raft_consensus.cc:729] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8323c20016b64dfa9827c2313b724d1f, State: Initialized, Role: FOLLOWER
I20260809 02:01:38.295451 3787 ts_tablet_manager.cc:1428] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:01:38.295454 3789 ts_tablet_manager.cc:1428] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260809 02:01:38.295759 3478 heartbeater.cc:503] Master 127.14.175.254:42819 was elected leader, sending a full tablet report...
I20260809 02:01:38.295907 3788 consensus_queue.cc:260] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.296665 3620 heartbeater.cc:503] Master 127.14.175.254:42819 was elected leader, sending a full tablet report...
I20260809 02:01:38.297648 3788 ts_tablet_manager.cc:1428] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260809 02:01:38.474790 3769 tablet.cc:2369] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:01:38.512210 3621 tablet.cc:2369] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:38.532763 3795 raft_consensus.cc:482] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:38.532980 3795 raft_consensus.cc:504] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.534127 3795 leader_election.cc:288] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72e83a74501b4a3f8dbf986cb7bc4c8c (127.14.175.195:45053), c495b5f7487a447d8b7dfe9a15b115cd (127.14.175.193:41061)
I20260809 02:01:38.538525 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.534322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:45053 (local address 127.14.175.194:48915)
0809 02:01:38.534636 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.534653 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.534808 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.535140 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.535142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.535161 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:38.535312 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.535320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.536454 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.536457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.537351 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.537360 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.538102 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.538106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.538204 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.538229 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.538303 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.538367 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":77,"thread_start_us":110,"threads_started":1}
I20260809 02:01:38.538550 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.534459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:48915 (local address 127.14.175.195:45053)
0809 02:01:38.534676 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.534681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.534729 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:01:38.534942 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.534946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.535032 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.535113 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:38.535496 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.536311 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.537479 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.537978 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.538089 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.538136 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.538342 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.538420 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260809 02:01:38.539048 3784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.534531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:60039 (local address 127.14.175.193:41061)
0809 02:01:38.534745 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.534749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.534896 (+ 147us) server_negotiation.cc:407] Connection header received
0809 02:01:38.535061 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.535064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.535137 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.535209 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:38.535553 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.536304 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.537767 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.538324 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.538430 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.538473 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.538791 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.538875 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260809 02:01:38.539202 3718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "685031a008ef44829ed744d5ae8ba41a" candidate_uuid: "8323c20016b64dfa9827c2313b724d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" is_pre_election: true
I20260809 02:01:38.539463 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.534423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:41061 (local address 127.14.175.194:60039)
0809 02:01:38.534737 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.534752 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:38.534928 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:38.535299 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:38.535301 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:38.535318 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:38.535433 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.535439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.536430 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.536434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.537643 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:38.537653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.538530 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.538534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:38.538642 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.538666 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:01:38.539208 (+ 542us) client_negotiation.cc:240] Negotiation successful
0809 02:01:38.539285 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":30,"thread_start_us":94,"threads_started":1}
I20260809 02:01:38.539530 3718 raft_consensus.cc:2454] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8323c20016b64dfa9827c2313b724d1f in term 0.
I20260809 02:01:38.539987 3499 leader_election.cc:302] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72e83a74501b4a3f8dbf986cb7bc4c8c, 8323c20016b64dfa9827c2313b724d1f; no voters:
I20260809 02:01:38.540124 3428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "685031a008ef44829ed744d5ae8ba41a" candidate_uuid: "8323c20016b64dfa9827c2313b724d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" is_pre_election: true
I20260809 02:01:38.540256 3795 raft_consensus.cc:2781] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:38.540336 3795 raft_consensus.cc:482] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:38.540381 3795 raft_consensus.cc:3037] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:38.540428 3428 raft_consensus.cc:2454] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8323c20016b64dfa9827c2313b724d1f in term 0.
I20260809 02:01:38.541620 3795 raft_consensus.cc:504] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
I20260809 02:01:38.541987 3795 leader_election.cc:288] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [CANDIDATE]: Term 1 election: Requested vote from peers 72e83a74501b4a3f8dbf986cb7bc4c8c (127.14.175.195:45053), c495b5f7487a447d8b7dfe9a15b115cd (127.14.175.193:41061)
I20260809 02:01:38.542317 3428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "685031a008ef44829ed744d5ae8ba41a" candidate_uuid: "8323c20016b64dfa9827c2313b724d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c495b5f7487a447d8b7dfe9a15b115cd"
I20260809 02:01:38.542472 3428 raft_consensus.cc:3037] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:38.542487 3718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "685031a008ef44829ed744d5ae8ba41a" candidate_uuid: "8323c20016b64dfa9827c2313b724d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c"
I20260809 02:01:38.542609 3718 raft_consensus.cc:3037] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:38.543690 3428 raft_consensus.cc:2454] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8323c20016b64dfa9827c2313b724d1f in term 1.
I20260809 02:01:38.543953 3718 raft_consensus.cc:2454] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8323c20016b64dfa9827c2313b724d1f in term 1.
I20260809 02:01:38.544001 3502 leader_election.cc:302] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8323c20016b64dfa9827c2313b724d1f, c495b5f7487a447d8b7dfe9a15b115cd; no voters:
I20260809 02:01:38.544178 3795 raft_consensus.cc:2781] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:38.544396 3795 raft_consensus.cc:686] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 1 LEADER]: Becoming Leader. State: Replica: 8323c20016b64dfa9827c2313b724d1f, State: Running, Role: LEADER
I20260809 02:01:38.544783 3795 consensus_queue.cc:237] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } }
W20260809 02:01:38.544842 3479 tablet.cc:2369] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:38.547755 3272 catalog_manager.cc:5495] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8323c20016b64dfa9827c2313b724d1f (127.14.175.194). New cstate: current_term: 1 leader_uuid: "8323c20016b64dfa9827c2313b724d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8323c20016b64dfa9827c2313b724d1f" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260809 02:01:38.560684 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.556903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.14.175.194:33469)
0809 02:01:38.557053 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.557057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.557071 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:01:38.557178 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.557180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.557232 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.557345 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:38.557648 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.558151 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.559191 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.559403 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.559509 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.559898 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:38.560299 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:38.560430 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.560494 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.560547 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:01:38.566391 3718 raft_consensus.cc:1261] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 1 FOLLOWER]: Refusing update from remote peer 8323c20016b64dfa9827c2313b724d1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:38.566391 3428 raft_consensus.cc:1261] T 685031a008ef44829ed744d5ae8ba41a P c495b5f7487a447d8b7dfe9a15b115cd [term 1 FOLLOWER]: Refusing update from remote peer 8323c20016b64dfa9827c2313b724d1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:38.567139 3795 consensus_queue.cc:1035] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e83a74501b4a3f8dbf986cb7bc4c8c" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 45053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:38.567363 3798 consensus_queue.cc:1035] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c495b5f7487a447d8b7dfe9a15b115cd" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:38.576205 3802 mvcc.cc:205] Tried to move back new op lower bound from 7316442720520699904 to 7316442720441970688. Current Snapshot: MvccSnapshot[applied={T|T < 7316442720520699904}]
I20260809 02:01:38.583673 3271 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:38.583880 3271 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:38.586406 3271 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72100a39a8364cf0ac126be15ababf38: Sending DeleteTablet for 3 replicas of tablet 685031a008ef44829ed744d5ae8ba41a
I20260809 02:01:38.587282 3550 tablet_service.cc:1514] Processing DeleteTablet for tablet 685031a008ef44829ed744d5ae8ba41a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:38 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:45896
I20260809 02:01:38.587314 3403 tablet_service.cc:1514] Processing DeleteTablet for tablet 685031a008ef44829ed744d5ae8ba41a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:38 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:36182
I20260809 02:01:38.587832 3812 tablet_replica.cc:330] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: stopping tablet replica
I20260809 02:01:38.588176 3812 raft_consensus.cc:2229] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:38.588218 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3337
I20260809 02:01:38.588284 3695 tablet_service.cc:1514] Processing DeleteTablet for tablet 685031a008ef44829ed744d5ae8ba41a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:38 UTC) from {username='kudu', principal='kudu/127.14.175.254@KRBTEST.COM'} at 127.0.0.1:57298
I20260809 02:01:38.588624 3812 raft_consensus.cc:2258] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:38.591938 3813 tablet_replica.cc:330] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: stopping tablet replica
I20260809 02:01:38.592340 3812 ts_tablet_manager.cc:1905] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:38.592734 3813 raft_consensus.cc:2229] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:38.593166 3813 raft_consensus.cc:2258] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:38.594895 3813 ts_tablet_manager.cc:1905] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:38.596074 3812 ts_tablet_manager.cc:1918] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:38.596185 3812 log.cc:1196] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/685031a008ef44829ed744d5ae8ba41a
I20260809 02:01:38.596524 3812 ts_tablet_manager.cc:1939] T 685031a008ef44829ed744d5ae8ba41a P 8323c20016b64dfa9827c2313b724d1f: Deleting consensus metadata
I20260809 02:01:38.597872 3260 catalog_manager.cc:4841] TS 8323c20016b64dfa9827c2313b724d1f (127.14.175.194:33469): tablet 685031a008ef44829ed744d5ae8ba41a (table test-table [id=b4134578d83b4b1183a8029909e6488c]) successfully deleted
I20260809 02:01:38.598359 3813 ts_tablet_manager.cc:1918] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:38.598516 3813 log.cc:1196] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/685031a008ef44829ed744d5ae8ba41a
W20260809 02:01:38.599000 3260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:41061 (error 108)
I20260809 02:01:38.599211 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3483
I20260809 02:01:38.601830 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.601444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:41061 (local address 127.0.0.1:57816)
0809 02:01:38.601642 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:38.601718 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:41061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260809 02:01:38.602039 3260 catalog_manager.cc:4584] TS c495b5f7487a447d8b7dfe9a15b115cd (127.14.175.193:41061): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 685031a008ef44829ed744d5ae8ba41a: Network error: Client connection negotiation failed: client connection to 127.14.175.193:41061: connect: Connection refused (error 111)
I20260809 02:01:38.602288 3813 ts_tablet_manager.cc:1939] T 685031a008ef44829ed744d5ae8ba41a P 72e83a74501b4a3f8dbf986cb7bc4c8c: Deleting consensus metadata
I20260809 02:01:38.603543 3257 catalog_manager.cc:4841] TS 72e83a74501b4a3f8dbf986cb7bc4c8c (127.14.175.195:45053): tablet 685031a008ef44829ed744d5ae8ba41a (table test-table [id=b4134578d83b4b1183a8029909e6488c]) successfully deleted
I20260809 02:01:38.607309 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3625
I20260809 02:01:38.614383 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3240
2026-08-09T02:01:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2443 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T02:01:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:38Z Disabled control of system clock
I20260809 02:01:38.647279 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32903
--webserver_interface=127.14.175.254
--webserver_port=0
--builtin_ntp_servers=127.14.175.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:32903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:38.765113 3821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:38.765373 3821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:38.765412 3821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:38.769738 3821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:38.769793 3821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:38.769809 3821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:38.769826 3821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:38.769843 3821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:38.775122 3821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:32903
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:32903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:38.776105 3821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:38.777418 3821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:38.786243 3827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:38.786262 3826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:38.786250 3829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:38.786543 3821 server_base.cc:1034] running on GCE node
I20260809 02:01:38.787173 3821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:38.788199 3821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:38.789413 3821 hybrid_clock.cc:648] HybridClock initialized: now 1786240898789385 us; error 42 us; skew 500 ppm
I20260809 02:01:38.791241 3821 webserver.cc:460] Webserver started at http://127.14.175.254:44167/ using document root <none> and password file <none>
I20260809 02:01:38.791808 3821 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:38.791900 3821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:38.792127 3821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:38.794148 3821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "925b39cb4b5846b986becaa859b45ab5"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f89eaab08758a621ab2cfeb339492227"
server_key_iv: "e5f0b51e13d5ef2aadd5d0390cf2e8fa"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.794725 3821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "925b39cb4b5846b986becaa859b45ab5"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f89eaab08758a621ab2cfeb339492227"
server_key_iv: "e5f0b51e13d5ef2aadd5d0390cf2e8fa"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.798339 3821 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:01:38.800802 3836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:38.801959 3821 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:01:38.802100 3821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "925b39cb4b5846b986becaa859b45ab5"
format_stamp: "Formatted at 2026-08-09 02:01:38 on dist-test-slave-2w3w"
server_key: "f89eaab08758a621ab2cfeb339492227"
server_key_iv: "e5f0b51e13d5ef2aadd5d0390cf2e8fa"
server_key_version: "encryptionkey@0"
I20260809 02:01:38.802214 3821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:38.816385 3821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:38.817040 3821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:38.817241 3821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:38.824429 3821 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:32903
I20260809 02:01:38.824438 3892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:32903 every 8 connection(s)
I20260809 02:01:38.825382 3821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:38.828399 3893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:38.833470 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3821
I20260809 02:01:38.833606 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:38.833937 15039 external_mini_cluster.cc:1428] Setting key d2b4809aad728c0b8106d4991363080d
I20260809 02:01:38.834015 3893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: Bootstrap starting.
I20260809 02:01:38.836723 3893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:38.837627 3893 log.cc:824] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:38.840584 3893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: No bootstrap required, opened a new log
I20260809 02:01:38.844442 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:38.835424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.14.175.254:32903)
0809 02:01:38.836093 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:38.836111 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:38.836154 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:01:38.837052 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:38.837074 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:38.837562 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:38.837934 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:38.838550 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.840166 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.841154 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:38.841640 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:38.841821 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:38.842692 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:38.842697 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:38.842709 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:38.843152 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:38.843215 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:38.843235 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:38.843338 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:38.843516 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 02:01:38.843758 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":112,"threads_started":1}
I20260809 02:01:38.844378 3893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } }
I20260809 02:01:38.844662 3893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:38.844735 3893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925b39cb4b5846b986becaa859b45ab5, State: Initialized, Role: FOLLOWER
I20260809 02:01:38.845202 3893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } }
I20260809 02:01:38.845364 3893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:38.845436 3893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:38.845522 3893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:38.846628 3893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } }
I20260809 02:01:38.847239 3893 leader_election.cc:302] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925b39cb4b5846b986becaa859b45ab5; no voters:
I20260809 02:01:38.847610 3893 leader_election.cc:288] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:38.847720 3898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:38.847939 3898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [term 1 LEADER]: Becoming Leader. State: Replica: 925b39cb4b5846b986becaa859b45ab5, State: Running, Role: LEADER
I20260809 02:01:38.848286 3898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } }
I20260809 02:01:38.848949 3893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:38.849798 3899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "925b39cb4b5846b986becaa859b45ab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } } }
I20260809 02:01:38.849953 3899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:38.850288 3900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925b39cb4b5846b986becaa859b45ab5. Latest consensus state: current_term: 1 leader_uuid: "925b39cb4b5846b986becaa859b45ab5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b39cb4b5846b986becaa859b45ab5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 32903 } } }
I20260809 02:01:38.850382 3900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:38.850646 3907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:38.853686 3907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:38.858585 3907 catalog_manager.cc:1347] Generated new cluster ID: 730495da9212490487f4594408353ba5
I20260809 02:01:38.858649 3907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:38.879601 3907 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:38.880442 3907 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:38.888701 3907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: Generated new TSK 0
I20260809 02:01:38.889341 3907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:38.895498 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.193:0
--local_ip_for_outbound_sockets=127.14.175.193
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--builtin_ntp_servers=127.14.175.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:01:39.015800 3918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:39.016047 3918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:39.016084 3918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:39.020049 3918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:39.020097 3918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:39.020148 3918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.193
I20260809 02:01:39.024650 3918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.175.193
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.193
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:39.025595 3918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:39.026870 3918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:39.036038 3925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.036033 3927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.036062 3924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:39.036360 3918 server_base.cc:1034] running on GCE node
I20260809 02:01:39.036770 3918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:39.037439 3918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:39.038631 3918 hybrid_clock.cc:648] HybridClock initialized: now 1786240899038616 us; error 31 us; skew 500 ppm
I20260809 02:01:39.040432 3918 webserver.cc:460] Webserver started at http://127.14.175.193:45915/ using document root <none> and password file <none>
I20260809 02:01:39.041002 3918 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:39.041105 3918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:39.041349 3918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:39.043512 3918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data/instance:
uuid: "da605a95855b46d9960c4f7b3b3edd2a"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "fa7c14be6b219967cfe00cf3418107a6"
server_key_iv: "ab2183a5c315973507997ef2cf481177"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.044081 3918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance:
uuid: "da605a95855b46d9960c4f7b3b3edd2a"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "fa7c14be6b219967cfe00cf3418107a6"
server_key_iv: "ab2183a5c315973507997ef2cf481177"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.049506 3918 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 02:01:39.052510 3933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.053720 3918 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:39.053849 3918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal
uuid: "da605a95855b46d9960c4f7b3b3edd2a"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "fa7c14be6b219967cfe00cf3418107a6"
server_key_iv: "ab2183a5c315973507997ef2cf481177"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.053970 3918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:39.085819 3918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:39.086524 3918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:39.086730 3918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:39.087364 3918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:39.088323 3918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:39.088397 3918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.088470 3918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:39.088524 3918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.097434 3918 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.193:43093
I20260809 02:01:39.097492 4053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.193:43093 every 8 connection(s)
I20260809 02:01:39.098292 3918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/data/info.pb
I20260809 02:01:39.103439 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 3918
I20260809 02:01:39.103605 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-0/wal/instance
I20260809 02:01:39.104004 15039 external_mini_cluster.cc:1428] Setting key d0563e94410bb34de5ca26d96bab2d8c
I20260809 02:01:39.107342 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.194:0
--local_ip_for_outbound_sockets=127.14.175.194
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--builtin_ntp_servers=127.14.175.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:39.116058 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.100112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.193:58623 (local address 127.14.175.254:32903)
0809 02:01:39.100275 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.100279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.110129 (+ 9850us) server_negotiation.cc:407] Connection header received
0809 02:01:39.111092 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.111095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.111154 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.111258 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:39.112267 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.112826 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.114052 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.114279 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.114389 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.115563 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:39.115567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:39.115570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:39.115583 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:39.115611 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:39.115620 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:39.115698 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.115857 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.115916 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:01:39.116961 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.100526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32903 (local address 127.14.175.193:58623)
0809 02:01:39.109982 (+ 9456us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.110025 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.110856 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.111451 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.111458 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.111547 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:39.112097 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.112122 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.112963 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.112967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.113911 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.113920 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.114431 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.114435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.114605 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.115308 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:39.115310 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:39.115348 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:39.115406 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:39.115712 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:39.115723 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:39.115734 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.115856 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.116218 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9073,"thread_start_us":602,"threads_started":1}
I20260809 02:01:39.118170 4054 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32903
I20260809 02:01:39.118425 4054 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:39.119102 4054 heartbeater.cc:511] Master 127.14.175.254:32903 requested a full tablet report, sending...
I20260809 02:01:39.120546 3854 ts_manager.cc:194] Registered new tserver with Master: da605a95855b46d9960c4f7b3b3edd2a (127.14.175.193:43093)
I20260809 02:01:39.121682 3854 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.193:58623
W20260809 02:01:39.251960 4057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:39.252218 4057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:39.252279 4057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:39.256405 4057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:39.256476 4057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:39.256561 4057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.194
I20260809 02:01:39.261492 4057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.175.194
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.194
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:39.262482 4057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:39.263856 4057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:39.274945 4063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.275020 4065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.274926 4062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:39.275249 4057 server_base.cc:1034] running on GCE node
I20260809 02:01:39.275647 4057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:39.276271 4057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:39.277452 4057 hybrid_clock.cc:648] HybridClock initialized: now 1786240899277422 us; error 42 us; skew 500 ppm
I20260809 02:01:39.279300 4057 webserver.cc:460] Webserver started at http://127.14.175.194:43197/ using document root <none> and password file <none>
I20260809 02:01:39.279860 4057 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:39.279920 4057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:39.280121 4057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:39.282037 4057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data/instance:
uuid: "95631e8137da4c55bfb6a043a7d2bf73"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "4aba65e8d5efd71cab39f413bdfcf05c"
server_key_iv: "6e6dad6fbab1de86cb9d4140ff55aaff"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.282586 4057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance:
uuid: "95631e8137da4c55bfb6a043a7d2bf73"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "4aba65e8d5efd71cab39f413bdfcf05c"
server_key_iv: "6e6dad6fbab1de86cb9d4140ff55aaff"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.286291 4057 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:01:39.288723 4071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.289949 4057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:01:39.290062 4057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal
uuid: "95631e8137da4c55bfb6a043a7d2bf73"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "4aba65e8d5efd71cab39f413bdfcf05c"
server_key_iv: "6e6dad6fbab1de86cb9d4140ff55aaff"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.290169 4057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:39.310084 4057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:39.310751 4057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:39.310993 4057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:39.311643 4057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:39.312563 4057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:39.312611 4057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.312676 4057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:39.312709 4057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.323916 4057 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.194:40273
I20260809 02:01:39.324081 4196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.194:40273 every 8 connection(s)
I20260809 02:01:39.324868 4057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/data/info.pb
I20260809 02:01:39.325399 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4057
I20260809 02:01:39.325562 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal/instance
I20260809 02:01:39.325949 15039 external_mini_cluster.cc:1428] Setting key 60904fc2ffc5fd368113de3997d6da76
I20260809 02:01:39.328624 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.175.195:0
--local_ip_for_outbound_sockets=127.14.175.195
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--builtin_ntp_servers=127.14.175.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:01:39.336722 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.326833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.194:55971 (local address 127.14.175.254:32903)
0809 02:01:39.326988 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.326992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.328237 (+ 1245us) server_negotiation.cc:407] Connection header received
0809 02:01:39.329811 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.329815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.329878 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.329960 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:39.331051 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.332034 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.333940 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.334402 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.334539 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.336040 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:39.336045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:39.336050 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:39.336070 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:39.336102 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:39.336115 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:39.336215 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.336428 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.336510 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:01:39.337965 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.327329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32903 (local address 127.14.175.194:55971)
0809 02:01:39.328094 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.328147 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.329603 (+ 1456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.330126 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.330132 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.330220 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:39.330829 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.330853 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.332206 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.332213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.333790 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.333804 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.334598 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.334605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.334855 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.335684 (+ 829us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:39.335688 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:39.335746 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:39.335836 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:39.336230 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:39.336241 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:39.336250 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.336407 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.336750 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":171,"threads_started":1}
I20260809 02:01:39.339306 4197 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32903
I20260809 02:01:39.339600 4197 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:39.340252 4197 heartbeater.cc:511] Master 127.14.175.254:32903 requested a full tablet report, sending...
I20260809 02:01:39.341513 3854 ts_manager.cc:194] Registered new tserver with Master: 95631e8137da4c55bfb6a043a7d2bf73 (127.14.175.194:40273)
I20260809 02:01:39.342440 3854 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.194:55971
W20260809 02:01:39.442207 4200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:39.442466 4200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:39.442526 4200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:39.446467 4200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:39.446563 4200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:39.446648 4200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.175.195
I20260809 02:01:39.451539 4200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.175.195
--webserver_port=0
--tserver_master_addrs=127.14.175.254:32903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.175.195
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:39.452579 4200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:39.453893 4200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:39.463385 4205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.463451 4207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:39.463378 4210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:39.463575 4200 server_base.cc:1034] running on GCE node
I20260809 02:01:39.463976 4200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:39.464588 4200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:39.465751 4200 hybrid_clock.cc:648] HybridClock initialized: now 1786240899465726 us; error 36 us; skew 500 ppm
I20260809 02:01:39.472116 4200 webserver.cc:460] Webserver started at http://127.14.175.195:40449/ using document root <none> and password file <none>
I20260809 02:01:39.472673 4200 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:39.472738 4200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:39.473002 4200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:39.475071 4200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data/instance:
uuid: "70e9bd4d71bf4a7fb146de1edd79677f"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "c35c8d766563dbbb6f6abceb406f2e04"
server_key_iv: "3cc6e8d8667975fd10d5d199d273c2f3"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.475636 4200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance:
uuid: "70e9bd4d71bf4a7fb146de1edd79677f"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "c35c8d766563dbbb6f6abceb406f2e04"
server_key_iv: "3cc6e8d8667975fd10d5d199d273c2f3"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.479161 4200 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:01:39.481496 4217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.482606 4200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:39.482728 4200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal
uuid: "70e9bd4d71bf4a7fb146de1edd79677f"
format_stamp: "Formatted at 2026-08-09 02:01:39 on dist-test-slave-2w3w"
server_key: "c35c8d766563dbbb6f6abceb406f2e04"
server_key_iv: "3cc6e8d8667975fd10d5d199d273c2f3"
server_key_version: "encryptionkey@0"
I20260809 02:01:39.482829 4200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:39.496582 4200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:39.497205 4200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:39.497397 4200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:39.497958 4200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:01:39.498860 4200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:01:39.498906 4200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.498989 4200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:01:39.499045 4200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:39.508076 4200 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.195:46853
I20260809 02:01:39.508111 4338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.195:46853 every 8 connection(s)
I20260809 02:01:39.508877 4200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/data/info.pb
I20260809 02:01:39.517016 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4200
I20260809 02:01:39.517154 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal/instance
I20260809 02:01:39.517534 15039 external_mini_cluster.cc:1428] Setting key e976a75c4f49f191454096c16a45042e
I20260809 02:01:39.517802 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.510690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:53587 (local address 127.14.175.254:32903)
0809 02:01:39.510859 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.510864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.511939 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 02:01:39.513263 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.513266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.513314 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.513391 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:39.514245 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.514760 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.515867 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.516089 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.516167 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.517286 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:39.517290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:39.517292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:39.517303 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:39.517328 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:39.517337 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:39.517398 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.517626 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.517691 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 02:01:39.518738 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.511114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:32903 (local address 127.14.175.195:53587)
0809 02:01:39.511768 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.511806 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.513086 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.513552 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.513558 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.513636 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:01:39.514123 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.514135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.514903 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.514905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.515765 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.515774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.516217 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.516220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.516353 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.516953 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:01:39.516955 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:01:39.517012 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:01:39.517089 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:01:39.517431 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:01:39.517440 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:01:39.517446 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.517593 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.517893 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":114,"threads_started":1}
I20260809 02:01:39.520004 4339 heartbeater.cc:347] Connected to a master server at 127.14.175.254:32903
I20260809 02:01:39.520227 4339 heartbeater.cc:464] Registering TS with master...
I20260809 02:01:39.520699 4339 heartbeater.cc:511] Master 127.14.175.254:32903 requested a full tablet report, sending...
I20260809 02:01:39.521615 3854 ts_manager.cc:194] Registered new tserver with Master: 70e9bd4d71bf4a7fb146de1edd79677f (127.14.175.195:46853)
I20260809 02:01:39.522128 3854 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.175.195:53587
I20260809 02:01:39.531414 15039 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:01:39.537231 3896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.533357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48410 (local address 127.14.175.254:32903)
0809 02:01:39.533514 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.533519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.533680 (+ 161us) server_negotiation.cc:407] Connection header received
0809 02:01:39.533860 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.533863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.533912 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.533996 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:39.534273 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.534802 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.535688 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.535917 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.536034 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.536795 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:39.536799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:39.536802 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:39.536821 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:39.536838 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:39.536846 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:39.536922 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.537046 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.537097 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:01:39.539996 3854 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:01:39.542948 3854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:01:39.557756 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.552099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40273 (local address 127.0.0.1:58970)
0809 02:01:39.552963 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.552977 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.553074 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.553504 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.553507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.553524 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:39.553623 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.553631 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.554695 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.554698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.556323 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.556335 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557180 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.557315 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557356 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.557461 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.557597 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":170,"thread_start_us":98,"threads_started":1}
I20260809 02:01:39.558090 4352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.551463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43093 (local address 127.0.0.1:46078)
0809 02:01:39.552680 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.552695 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.552778 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.553757 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.553759 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.553789 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:39.553864 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.553869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.555066 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.555071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.556161 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.556171 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557475 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.557748 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557799 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.557870 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.557955 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":80,"thread_start_us":79,"threads_started":1}
I20260809 02:01:39.558211 4353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.551905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.14.175.195:46853)
0809 02:01:39.552357 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.552366 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.552386 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:01:39.552479 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.552484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.552683 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.552853 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:39.553343 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.554486 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.556458 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557178 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557280 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557445 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.557954 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.558052 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":140,"threads_started":1}
I20260809 02:01:39.558537 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.552528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.14.175.194:40273)
0809 02:01:39.552955 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.552968 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.553062 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:01:39.553176 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.553183 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.553376 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.553525 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:39.553743 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.554568 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.556473 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557051 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557181 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557372 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.558128 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.558379 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":136,"threads_started":1}
I20260809 02:01:39.558562 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.551386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.195:46853 (local address 127.0.0.1:53138)
0809 02:01:39.551787 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.551842 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.551967 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.553036 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.553044 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.553087 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:39.553211 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.553217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.554610 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.554616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.556323 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.556335 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557495 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.557750 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557795 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.557870 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.558419 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":729,"spinlock_wait_cycles":5376,"thread_start_us":69,"threads_started":1}
I20260809 02:01:39.559054 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.552088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46078 (local address 127.14.175.193:43093)
0809 02:01:39.553173 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.553179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.553208 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:01:39.553267 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.553298 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.553483 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.553626 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:39.553993 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.554933 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.556285 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.557099 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.557234 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.557403 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.558779 (+ 1376us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.558899 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":95,"threads_started":1}
I20260809 02:01:39.561146 4125 tablet_service.cc:1467] Processing CreateTablet for tablet 66345aa4a58346a68a9f5019a53e1312 (DEFAULT_TABLE table=test-table [id=e2ae7f19e4bc40b283b5202242384e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:39.561368 4268 tablet_service.cc:1467] Processing CreateTablet for tablet 66345aa4a58346a68a9f5019a53e1312 (DEFAULT_TABLE table=test-table [id=e2ae7f19e4bc40b283b5202242384e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:39.561587 3984 tablet_service.cc:1467] Processing CreateTablet for tablet 66345aa4a58346a68a9f5019a53e1312 (DEFAULT_TABLE table=test-table [id=e2ae7f19e4bc40b283b5202242384e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:01:39.562148 4125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66345aa4a58346a68a9f5019a53e1312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:39.562387 4268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66345aa4a58346a68a9f5019a53e1312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:39.562408 3984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66345aa4a58346a68a9f5019a53e1312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:39.568583 4357 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Bootstrap starting.
I20260809 02:01:39.570142 4359 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Bootstrap starting.
I20260809 02:01:39.570781 4357 tablet_bootstrap.cc:654] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:39.571307 4358 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Bootstrap starting.
I20260809 02:01:39.571768 4357 log.cc:824] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:39.571992 4359 tablet_bootstrap.cc:654] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:39.573292 4358 tablet_bootstrap.cc:654] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:39.573374 4359 log.cc:824] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:39.573961 4357 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: No bootstrap required, opened a new log
I20260809 02:01:39.574067 4358 log.cc:824] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:39.574182 4357 ts_tablet_manager.cc:1397] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:01:39.575541 4359 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: No bootstrap required, opened a new log
I20260809 02:01:39.575748 4358 tablet_bootstrap.cc:492] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: No bootstrap required, opened a new log
I20260809 02:01:39.575762 4359 ts_tablet_manager.cc:1397] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:01:39.575939 4358 ts_tablet_manager.cc:1397] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:01:39.578604 4357 raft_consensus.cc:348] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.578888 4357 raft_consensus.cc:374] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:39.578972 4357 raft_consensus.cc:729] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95631e8137da4c55bfb6a043a7d2bf73, State: Initialized, Role: FOLLOWER
I20260809 02:01:39.578828 4358 raft_consensus.cc:348] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.579104 4358 raft_consensus.cc:374] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:39.579162 4358 raft_consensus.cc:729] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e9bd4d71bf4a7fb146de1edd79677f, State: Initialized, Role: FOLLOWER
I20260809 02:01:39.579470 4357 consensus_queue.cc:260] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.579602 4358 consensus_queue.cc:260] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.579962 4359 raft_consensus.cc:348] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.580236 4359 raft_consensus.cc:374] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:39.580468 4359 raft_consensus.cc:729] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da605a95855b46d9960c4f7b3b3edd2a, State: Initialized, Role: FOLLOWER
I20260809 02:01:39.580559 4358 ts_tablet_manager.cc:1428] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:01:39.580647 4357 ts_tablet_manager.cc:1428] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:01:39.580928 4339 heartbeater.cc:503] Master 127.14.175.254:32903 was elected leader, sending a full tablet report...
I20260809 02:01:39.580983 4197 heartbeater.cc:503] Master 127.14.175.254:32903 was elected leader, sending a full tablet report...
I20260809 02:01:39.581192 4359 consensus_queue.cc:260] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.581959 4054 heartbeater.cc:503] Master 127.14.175.254:32903 was elected leader, sending a full tablet report...
I20260809 02:01:39.582113 4359 ts_tablet_manager.cc:1428] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260809 02:01:39.597947 4367 raft_consensus.cc:482] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:01:39.598120 4367 raft_consensus.cc:504] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.599288 4367 leader_election.cc:288] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da605a95855b46d9960c4f7b3b3edd2a (127.14.175.193:43093), 95631e8137da4c55bfb6a043a7d2bf73 (127.14.175.194:40273)
W20260809 02:01:39.599334 4055 tablet.cc:2369] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:01:39.603328 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.599512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43093 (local address 127.14.175.195:39529)
0809 02:01:39.599676 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.599693 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.599776 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.600117 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.600121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.600139 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:39.600293 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.600300 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.601250 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.601253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.602143 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.602152 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.602886 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.602890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.603013 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.603039 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.603128 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.603196 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 02:01:39.603374 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.599658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:39529 (local address 127.14.175.193:43093)
0809 02:01:39.599785 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.599789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.599804 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:01:39.599856 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.599862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.599908 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.599985 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:39.600453 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.601139 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.602267 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.602770 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.602863 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.602898 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.603160 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.603228 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:01:39.603631 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.600035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.175.195:43633 (local address 127.14.175.194:40273)
0809 02:01:39.600181 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.600185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.600383 (+ 198us) server_negotiation.cc:407] Connection header received
0809 02:01:39.600498 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.600500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.600538 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.600592 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:01:39.600896 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.601466 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.602548 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.603040 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.603162 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.603203 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.603417 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.603500 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:01:39.603636 4369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.599777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40273 (local address 127.14.175.195:43633)
0809 02:01:39.600261 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.600273 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:01:39.600402 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:01:39.600629 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:01:39.600632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:01:39.600649 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:01:39.600767 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.600773 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.601573 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.601575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.602420 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:01:39.602430 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.603181 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.603185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:01:39.603280 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.603303 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:01:39.603387 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:01:39.603461 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":187,"threads_started":1}
I20260809 02:01:39.603976 4005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66345aa4a58346a68a9f5019a53e1312" candidate_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da605a95855b46d9960c4f7b3b3edd2a" is_pre_election: true
I20260809 02:01:39.604259 4005 raft_consensus.cc:2454] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e9bd4d71bf4a7fb146de1edd79677f in term 0.
I20260809 02:01:39.604604 4147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66345aa4a58346a68a9f5019a53e1312" candidate_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95631e8137da4c55bfb6a043a7d2bf73" is_pre_election: true
I20260809 02:01:39.604739 4221 leader_election.cc:302] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e9bd4d71bf4a7fb146de1edd79677f, da605a95855b46d9960c4f7b3b3edd2a; no voters:
I20260809 02:01:39.604893 4147 raft_consensus.cc:2454] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e9bd4d71bf4a7fb146de1edd79677f in term 0.
I20260809 02:01:39.605067 4367 raft_consensus.cc:2781] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:01:39.605159 4367 raft_consensus.cc:482] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:01:39.605206 4367 raft_consensus.cc:3037] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:39.606349 4367 raft_consensus.cc:504] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.606706 4367 leader_election.cc:288] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [CANDIDATE]: Term 1 election: Requested vote from peers da605a95855b46d9960c4f7b3b3edd2a (127.14.175.193:43093), 95631e8137da4c55bfb6a043a7d2bf73 (127.14.175.194:40273)
I20260809 02:01:39.607095 4005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66345aa4a58346a68a9f5019a53e1312" candidate_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da605a95855b46d9960c4f7b3b3edd2a"
I20260809 02:01:39.607180 4147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66345aa4a58346a68a9f5019a53e1312" candidate_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95631e8137da4c55bfb6a043a7d2bf73"
I20260809 02:01:39.607232 4005 raft_consensus.cc:3037] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:39.607311 4147 raft_consensus.cc:3037] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:39.608266 4005 raft_consensus.cc:2454] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e9bd4d71bf4a7fb146de1edd79677f in term 1.
I20260809 02:01:39.608325 4147 raft_consensus.cc:2454] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70e9bd4d71bf4a7fb146de1edd79677f in term 1.
I20260809 02:01:39.608587 4221 leader_election.cc:302] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e9bd4d71bf4a7fb146de1edd79677f, da605a95855b46d9960c4f7b3b3edd2a; no voters:
I20260809 02:01:39.608772 4367 raft_consensus.cc:2781] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:39.609043 4367 raft_consensus.cc:686] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 1 LEADER]: Becoming Leader. State: Replica: 70e9bd4d71bf4a7fb146de1edd79677f, State: Running, Role: LEADER
I20260809 02:01:39.609356 4367 consensus_queue.cc:237] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } }
I20260809 02:01:39.612486 3853 catalog_manager.cc:5495] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f reported cstate change: term changed from 0 to 1, leader changed from <none> to 70e9bd4d71bf4a7fb146de1edd79677f (127.14.175.195). New cstate: current_term: 1 leader_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e9bd4d71bf4a7fb146de1edd79677f" member_type: VOTER last_known_addr { host: "127.14.175.195" port: 46853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 } health_report { overall_health: UNKNOWN } } }
I20260809 02:01:39.635118 4353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.631444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53148 (local address 127.14.175.195:46853)
0809 02:01:39.631605 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:39.631609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:39.631625 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:01:39.631705 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:39.631708 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:39.631770 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:39.631883 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:01:39.632154 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.632671 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.633597 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:39.633832 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:39.633945 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:39.634269 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:01:39.634658 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:01:39.634812 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:39.634881 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:01:39.634934 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 02:01:39.640972 4005 raft_consensus.cc:1261] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a [term 1 FOLLOWER]: Refusing update from remote peer 70e9bd4d71bf4a7fb146de1edd79677f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:39.640972 4147 raft_consensus.cc:1261] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 1 FOLLOWER]: Refusing update from remote peer 70e9bd4d71bf4a7fb146de1edd79677f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:01:39.641705 4367 consensus_queue.cc:1035] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da605a95855b46d9960c4f7b3b3edd2a" member_type: VOTER last_known_addr { host: "127.14.175.193" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:39.641948 4370 consensus_queue.cc:1035] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95631e8137da4c55bfb6a043a7d2bf73" member_type: VOTER last_known_addr { host: "127.14.175.194" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:01:39.649655 4374 mvcc.cc:205] Tried to move back new op lower bound from 7316442724921769984 to 7316442724802252800. Current Snapshot: MvccSnapshot[applied={T|T < 7316442724921769984}]
I20260809 02:01:39.651872 4376 mvcc.cc:205] Tried to move back new op lower bound from 7316442724921769984 to 7316442724802252800. Current Snapshot: MvccSnapshot[applied={T|T < 7316442724921769984}]
I20260809 02:01:39.658639 3853 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:39.658772 3853 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:01:39.661182 3853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 925b39cb4b5846b986becaa859b45ab5: Sending DeleteTablet for 3 replicas of tablet 66345aa4a58346a68a9f5019a53e1312
I20260809 02:01:39.661870 4268 tablet_service.cc:1514] Processing DeleteTablet for tablet 66345aa4a58346a68a9f5019a53e1312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:39 UTC) from {username='slave'} at 127.0.0.1:53138
I20260809 02:01:39.661947 4125 tablet_service.cc:1514] Processing DeleteTablet for tablet 66345aa4a58346a68a9f5019a53e1312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:39 UTC) from {username='slave'} at 127.0.0.1:58970
I20260809 02:01:39.662343 4384 tablet_replica.cc:330] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: stopping tablet replica
I20260809 02:01:39.662464 3984 tablet_service.cc:1514] Processing DeleteTablet for tablet 66345aa4a58346a68a9f5019a53e1312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:01:39 UTC) from {username='slave'} at 127.0.0.1:46078
I20260809 02:01:39.662793 4384 raft_consensus.cc:2229] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:01:39.662899 4386 tablet_replica.cc:330] T 66345aa4a58346a68a9f5019a53e1312 P da605a95855b46d9960c4f7b3b3edd2a: stopping tablet replica
I20260809 02:01:39.663120 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3918
I20260809 02:01:39.664942 4385 tablet_replica.cc:330] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: stopping tablet replica
I20260809 02:01:39.665143 4384 raft_consensus.cc:2258] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:39.665228 4385 raft_consensus.cc:2229] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:01:39.665510 4385 raft_consensus.cc:2258] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:01:39.666625 4384 ts_tablet_manager.cc:1905] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:39.670254 4384 ts_tablet_manager.cc:1918] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:39.670421 4384 log.cc:1196] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-2/wal/wals/66345aa4a58346a68a9f5019a53e1312
I20260809 02:01:39.670835 4384 ts_tablet_manager.cc:1939] T 66345aa4a58346a68a9f5019a53e1312 P 70e9bd4d71bf4a7fb146de1edd79677f: Deleting consensus metadata
I20260809 02:01:39.670908 4385 ts_tablet_manager.cc:1905] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:01:39.672212 3838 catalog_manager.cc:4841] TS 70e9bd4d71bf4a7fb146de1edd79677f (127.14.175.195:46853): tablet 66345aa4a58346a68a9f5019a53e1312 (table test-table [id=e2ae7f19e4bc40b283b5202242384e2c]) successfully deleted
I20260809 02:01:39.673524 4385 ts_tablet_manager.cc:1918] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:01:39.673622 4385 log.cc:1196] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Deleting WAL directory at /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786240649484061-15039-0/minicluster-data/ts-1/wal/wals/66345aa4a58346a68a9f5019a53e1312
W20260809 02:01:39.673810 3840 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.175.193:43093 (error 108)
I20260809 02:01:39.673909 4385 ts_tablet_manager.cc:1939] T 66345aa4a58346a68a9f5019a53e1312 P 95631e8137da4c55bfb6a043a7d2bf73: Deleting consensus metadata
I20260809 02:01:39.674697 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4057
I20260809 02:01:39.674923 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.674556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.193:43093 (local address 127.0.0.1:46094)
0809 02:01:39.674732 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.674824 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260809 02:01:39.675371 3840 catalog_manager.cc:4584] TS da605a95855b46d9960c4f7b3b3edd2a (127.14.175.193:43093): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 66345aa4a58346a68a9f5019a53e1312: Network error: Client connection negotiation failed: client connection to 127.14.175.193:43093: connect: Connection refused (error 111)
I20260809 02:01:39.685881 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4200
I20260809 02:01:39.686120 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:39.685795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.194:40273 (local address 127.0.0.1:58972)
0809 02:01:39.685976 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:01:39.686042 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.194:40273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 02:01:39.692270 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 3821
2026-08-09T02:01:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1076 ms)
[----------] 6 tests from EncryptionPolicyTest (10388 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:39 dist-test-slave-2w3w krb5kdc[4390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:39 dist-test-slave-2w3w krb5kdc[4390](info): set up 2 sockets
Aug 09 02:01:39 dist-test-slave-2w3w krb5kdc[4390](info): commencing operation
krb5kdc: starting...
W20260809 02:01:40.775064 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:40 dist-test-slave-2w3w krb5kdc[4390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:40.898960 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:41.010560 4404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:41.010870 4404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:41.010986 4404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:41.015055 4404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:41.015136 4404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:41.015172 4404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:41.015208 4404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:41.015242 4404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:41.020594 4404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36353
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:41.021646 4404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:41.022832 4404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:41.031239 4409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:41.031281 4410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:41.031425 4412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:41.031448 4404 server_base.cc:1034] running on GCE node
I20260809 02:01:41.032198 4404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:41.033201 4404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:41.034374 4404 hybrid_clock.cc:648] HybridClock initialized: now 1786240901034340 us; error 45 us; skew 500 ppm
Aug 09 02:01:41 dist-test-slave-2w3w krb5kdc[4390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240901, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:41.037243 4404 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:41.038146 4404 webserver.cc:460] Webserver started at http://127.0.0.1:38435/ using document root <none> and password file <none>
I20260809 02:01:41.038681 4404 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:41.038779 4404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:41.039072 4404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:41.041035 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "5bdc74c844e14656b5d172104c2a5802"
format_stamp: "Formatted at 2026-08-09 02:01:41 on dist-test-slave-2w3w"
server_key: "7c41ff3e22978d7e36e887c6dbee49b7"
server_key_iv: "2ace5d775f4facbd56846cb4c5aabbc9"
server_key_version: "encryptionkey@0"
I20260809 02:01:41.041599 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "5bdc74c844e14656b5d172104c2a5802"
format_stamp: "Formatted at 2026-08-09 02:01:41 on dist-test-slave-2w3w"
server_key: "7c41ff3e22978d7e36e887c6dbee49b7"
server_key_iv: "2ace5d775f4facbd56846cb4c5aabbc9"
server_key_version: "encryptionkey@0"
I20260809 02:01:41.045547 4404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:01:41.048863 4420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:41.051105 4404 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:01:41.051237 4404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "5bdc74c844e14656b5d172104c2a5802"
format_stamp: "Formatted at 2026-08-09 02:01:41 on dist-test-slave-2w3w"
server_key: "7c41ff3e22978d7e36e887c6dbee49b7"
server_key_iv: "2ace5d775f4facbd56846cb4c5aabbc9"
server_key_version: "encryptionkey@0"
I20260809 02:01:41.051373 4404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:41.063567 4404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:41.066182 4404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:41.066403 4404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:41.073396 4404 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36353
I20260809 02:01:41.073414 4476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36353 every 8 connection(s)
I20260809 02:01:41.074277 4404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:41.075126 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4404
I20260809 02:01:41.075284 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:41.075603 15039 external_mini_cluster.cc:1428] Setting key 566bd51408bda7541cc2adecf1c4639d
I20260809 02:01:41.077282 4477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:41.083722 4477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802: Bootstrap starting.
Aug 09 02:01:41 dist-test-slave-2w3w krb5kdc[4390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:01:41.086014 4477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:41.086740 4477 log.cc:824] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:41.088568 4477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802: No bootstrap required, opened a new log
I20260809 02:01:41.090507 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:41.076977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44757 (local address 127.0.0.1:36353)
0809 02:01:41.077398 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:41.077417 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:41.077457 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:01:41.078293 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:41.078314 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:41.078707 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:41.079086 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:41.079768 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:41.081299 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:41.082185 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:41.082884 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:41.083075 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:41.085609 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:41.085615 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:41.085629 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:41.085659 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:41.087699 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:41.088246 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:41.088251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:41.088255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:41.088370 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:41.088721 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:41.088726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:41.088733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:41.089097 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:41.089317 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:41.089639 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 02:01:41.089856 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":127,"threads_started":1}
I20260809 02:01:41.092224 4477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260809 02:01:41.092537 4477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:41.092619 4477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bdc74c844e14656b5d172104c2a5802, State: Initialized, Role: FOLLOWER
I20260809 02:01:41.093044 4477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260809 02:01:41.093171 4477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:41.093258 4477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:41.093369 4477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:41.093488 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:41.094524 4477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260809 02:01:41.094910 4477 leader_election.cc:302] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bdc74c844e14656b5d172104c2a5802; no voters:
I20260809 02:01:41.095263 4477 leader_election.cc:288] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:41.095356 4487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:41.095614 4487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [term 1 LEADER]: Becoming Leader. State: Replica: 5bdc74c844e14656b5d172104c2a5802, State: Running, Role: LEADER
I20260809 02:01:41.095909 4487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260809 02:01:41.096581 4477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:41.097532 4488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bdc74c844e14656b5d172104c2a5802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } } }
I20260809 02:01:41.097661 4488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:41.097987 4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bdc74c844e14656b5d172104c2a5802. Latest consensus state: current_term: 1 leader_uuid: "5bdc74c844e14656b5d172104c2a5802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc74c844e14656b5d172104c2a5802" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } } }
I20260809 02:01:41.098100 4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:41.098361 4498 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:41.101961 4498 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:41.105520 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:41.095750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55297 (local address 127.0.0.1:36353)
0809 02:01:41.095862 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:41.095866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:41.096398 (+ 532us) server_negotiation.cc:407] Connection header received
0809 02:01:41.096497 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:41.096500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:41.096544 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:41.096625 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:41.097480 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:41.098301 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:41.099559 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:41.099891 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:41.100008 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:41.101627 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:41.101643 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:41.101646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:41.101670 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:41.103565 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:41.104145 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:41.104149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:41.104151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:41.104237 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:41.104612 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:41.104615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:41.104617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:41.104822 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:41.104956 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:41.105287 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 02:01:41.105382 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:01:41.107640 4498 catalog_manager.cc:1347] Generated new cluster ID: 536136166bac4a3b94a22df7a4e78509
I20260809 02:01:41.107698 4498 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:41.137470 4498 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:41.138441 4498 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:41.143121 4498 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bdc74c844e14656b5d172104c2a5802: Generated new TSK 0
I20260809 02:01:41.143764 4498 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:41.152343 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4404
W20260809 02:01:41.159499 4388 connection.cc:535] client connection to 127.0.0.1:36353 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36353): Connection reset by peer (error 104)
2026-08-09T02:01:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:41 dist-test-slave-2w3w krb5kdc[4511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:41 dist-test-slave-2w3w krb5kdc[4511](info): set up 2 sockets
Aug 09 02:01:41 dist-test-slave-2w3w krb5kdc[4511](info): commencing operation
krb5kdc: starting...
W20260809 02:01:42.228811 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:42 dist-test-slave-2w3w krb5kdc[4511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:42.352137 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:42.462639 4524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:42.462922 4524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:42.463019 4524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:42.466944 4524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:42.467082 4524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:42.467121 4524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:42.467175 4524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:42.467212 4524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:42.472461 4524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:42.473524 4524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:42.474568 4524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:42.483248 4533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:42.483282 4529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:42.483480 4524 server_base.cc:1034] running on GCE node
W20260809 02:01:42.483250 4530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:42.484155 4524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:42.485234 4524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:42.486423 4524 hybrid_clock.cc:648] HybridClock initialized: now 1786240902486393 us; error 52 us; skew 500 ppm
Aug 09 02:01:42 dist-test-slave-2w3w krb5kdc[4511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240902, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:42.489185 4524 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:42.490078 4524 webserver.cc:460] Webserver started at http://127.0.0.1:34747/ using document root <none> and password file <none>
I20260809 02:01:42.490629 4524 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:42.490720 4524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:42.490948 4524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:42.493017 4524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "476e9258105d40f7abb0eb2165893641"
format_stamp: "Formatted at 2026-08-09 02:01:42 on dist-test-slave-2w3w"
server_key: "1fd67c0407f0b05e4c714e158c6c8dde"
server_key_iv: "d33e356c2b69000c9bb190755dfe80b2"
server_key_version: "encryptionkey@0"
I20260809 02:01:42.493584 4524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "476e9258105d40f7abb0eb2165893641"
format_stamp: "Formatted at 2026-08-09 02:01:42 on dist-test-slave-2w3w"
server_key: "1fd67c0407f0b05e4c714e158c6c8dde"
server_key_iv: "d33e356c2b69000c9bb190755dfe80b2"
server_key_version: "encryptionkey@0"
I20260809 02:01:42.497238 4524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:01:42.499713 4540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:42.500948 4524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:01:42.501096 4524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "476e9258105d40f7abb0eb2165893641"
format_stamp: "Formatted at 2026-08-09 02:01:42 on dist-test-slave-2w3w"
server_key: "1fd67c0407f0b05e4c714e158c6c8dde"
server_key_iv: "d33e356c2b69000c9bb190755dfe80b2"
server_key_version: "encryptionkey@0"
I20260809 02:01:42.501209 4524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:42.539904 4524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:42.542794 4524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:42.543061 4524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:42.550298 4524 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42917
I20260809 02:01:42.550330 4597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42917 every 8 connection(s)
I20260809 02:01:42.551333 4524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:42.554061 4598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:42.558882 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4524
I20260809 02:01:42.559056 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:42.559394 15039 external_mini_cluster.cc:1428] Setting key 35fc562e2dda9a74665b643fa646a7f4
I20260809 02:01:42.559540 4598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: Bootstrap starting.
I20260809 02:01:42.561939 4598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:42.562690 4598 log.cc:824] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:42.564816 4598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: No bootstrap required, opened a new log
I20260809 02:01:42.568735 4602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:42.560928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51271 (local address 127.0.0.1:42917)
0809 02:01:42.561366 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:42.561381 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:42.561420 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:01:42.562028 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:42.562069 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:42.562420 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:42.562685 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:42.563132 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:42.564232 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:42.565470 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:42.565934 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:42.566068 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:42.567040 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:42.567047 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:42.567059 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:42.567427 (+ 368us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:42.567479 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:42.567501 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:42.567616 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:42.567858 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 02:01:42.568006 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":134,"threads_started":1}
I20260809 02:01:42.568948 4598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } }
I20260809 02:01:42.569198 4598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:42.569279 4598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 476e9258105d40f7abb0eb2165893641, State: Initialized, Role: FOLLOWER
I20260809 02:01:42.569684 4598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } }
I20260809 02:01:42.569849 4598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:42.569914 4598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:42.570004 4598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:42.571178 4598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } }
I20260809 02:01:42.571528 4598 leader_election.cc:302] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 476e9258105d40f7abb0eb2165893641; no voters:
I20260809 02:01:42.571842 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:42.571872 4598 leader_election.cc:288] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:42.571954 4604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:42.572136 4604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [term 1 LEADER]: Becoming Leader. State: Replica: 476e9258105d40f7abb0eb2165893641, State: Running, Role: LEADER
I20260809 02:01:42.572436 4604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } }
I20260809 02:01:42.573122 4598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:42.574034 4606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "476e9258105d40f7abb0eb2165893641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } } }
I20260809 02:01:42.574167 4606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:42.574519 4605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 476e9258105d40f7abb0eb2165893641. Latest consensus state: current_term: 1 leader_uuid: "476e9258105d40f7abb0eb2165893641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e9258105d40f7abb0eb2165893641" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42917 } } }
I20260809 02:01:42.574584 4605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641 [sys.catalog]: This master's current role is: LEADER
W20260809 02:01:42.578068 4626 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:01:42.578152 4626 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:01:42.578493 4620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:42.578804 4602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:42.574866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36331 (local address 127.0.0.1:42917)
0809 02:01:42.575066 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:42.575070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:42.575081 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:01:42.575110 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:42.575112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:42.575144 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:42.575210 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:42.575615 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:42.576160 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:42.577050 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:42.577289 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:42.577396 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:42.578294 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:42.578297 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:42.578300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:42.578318 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:42.578342 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:42.578352 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:42.578456 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:42.578637 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 02:01:42.578673 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260809 02:01:42.579528 4620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:42.584885 4620 catalog_manager.cc:1347] Generated new cluster ID: 4f26ca50bf994a4dbf4fe6547f47dee9
I20260809 02:01:42.584954 4620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:42.608556 4620 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:42.610000 4620 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:42.618985 4620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 476e9258105d40f7abb0eb2165893641: Generated new TSK 0
I20260809 02:01:42.619626 4620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:42.623402 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4524
W20260809 02:01:42.630892 4508 connection.cc:535] client connection to 127.0.0.1:42917 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42917): Connection reset by peer (error 104)
2026-08-09T02:01:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1471 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:42 dist-test-slave-2w3w krb5kdc[4632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:42 dist-test-slave-2w3w krb5kdc[4632](info): set up 2 sockets
Aug 09 02:01:42 dist-test-slave-2w3w krb5kdc[4632](info): commencing operation
krb5kdc: starting...
W20260809 02:01:43.700955 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:43 dist-test-slave-2w3w krb5kdc[4632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:43.824112 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38105
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:43.934159 4647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:43.934409 4647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:43.934451 4647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:43.938326 4647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:43.938386 4647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:43.938405 4647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:43.938421 4647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:43.938436 4647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:43.943476 4647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38105
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:43.944397 4647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:43.945307 4647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:43.953758 4656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:43.953764 4654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:43.953775 4653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:43.953815 4647 server_base.cc:1034] running on GCE node
I20260809 02:01:43.954624 4647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:43.955750 4647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:43.956959 4647 hybrid_clock.cc:648] HybridClock initialized: now 1786240903956931 us; error 40 us; skew 500 ppm
Aug 09 02:01:43 dist-test-slave-2w3w krb5kdc[4632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240903, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:43.959831 4647 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:43.960783 4647 webserver.cc:460] Webserver started at http://127.0.0.1:43339/ using document root <none> and password file <none>
I20260809 02:01:43.961338 4647 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:43.961444 4647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:43.961688 4647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:43.963824 4647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "cbab8dec328c471b8001b2c9b672c081"
format_stamp: "Formatted at 2026-08-09 02:01:43 on dist-test-slave-2w3w"
server_key: "b045f08c6577aa8b5e972252e15157dc"
server_key_iv: "4ea21bac6e732b086e125c4b7d0818fc"
server_key_version: "encryptionkey@0"
I20260809 02:01:43.964411 4647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "cbab8dec328c471b8001b2c9b672c081"
format_stamp: "Formatted at 2026-08-09 02:01:43 on dist-test-slave-2w3w"
server_key: "b045f08c6577aa8b5e972252e15157dc"
server_key_iv: "4ea21bac6e732b086e125c4b7d0818fc"
server_key_version: "encryptionkey@0"
I20260809 02:01:43.968515 4647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 02:01:43.974241 4663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:43.976030 4647 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260809 02:01:43.976155 4647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "cbab8dec328c471b8001b2c9b672c081"
format_stamp: "Formatted at 2026-08-09 02:01:43 on dist-test-slave-2w3w"
server_key: "b045f08c6577aa8b5e972252e15157dc"
server_key_iv: "4ea21bac6e732b086e125c4b7d0818fc"
server_key_version: "encryptionkey@0"
I20260809 02:01:43.976271 4647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:43.981034 4647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:43.984156 4647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:43.984364 4647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:43.991811 4647 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38105
I20260809 02:01:43.991837 4716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38105 every 8 connection(s)
I20260809 02:01:43.992717 4647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:43.994483 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4647
I20260809 02:01:43.994645 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:43.995046 15039 external_mini_cluster.cc:1428] Setting key 9a6fdaa64f5d80a174bd0878cb7b7df6
I20260809 02:01:43.995920 4717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:44.000913 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:43.996444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33329 (local address 127.0.0.1:38105)
0809 02:01:43.996907 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:43.996929 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:43.996974 (+ 45us) server_negotiation.cc:407] Connection header received
0809 02:01:43.997905 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:43.997930 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:43.998304 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:43.998688 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:43.999428 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:43.999436 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:43.999453 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:43.999465 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:43.999527 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:43.999556 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:43.999710 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:43.999781 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 02:01:43.999953 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":120,"threads_started":1}
I20260809 02:01:44.003501 4717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081: Bootstrap starting.
I20260809 02:01:44.003945 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:44.006469 4717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:44.007452 4717 log.cc:824] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:44.008174 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:44.006404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34409 (local address 127.0.0.1:38105)
0809 02:01:44.006540 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:44.006547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:44.006686 (+ 139us) server_negotiation.cc:407] Connection header received
0809 02:01:44.006764 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:44.006771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:44.006812 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:44.006907 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:44.007701 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:44.007705 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:44.007708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:44.007722 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:44.007754 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:44.007773 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:44.007879 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:44.007983 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 02:01:44.008016 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:01:44.009471 4717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081: No bootstrap required, opened a new log
I20260809 02:01:44.013074 4717 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } }
I20260809 02:01:44.013329 4717 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:44.013411 4717 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbab8dec328c471b8001b2c9b672c081, State: Initialized, Role: FOLLOWER
I20260809 02:01:44.013859 4717 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } }
I20260809 02:01:44.014012 4717 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:44.014086 4717 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:44.014185 4717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:44.015225 4717 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } }
I20260809 02:01:44.015573 4717 leader_election.cc:302] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbab8dec328c471b8001b2c9b672c081; no voters:
I20260809 02:01:44.015890 4717 leader_election.cc:288] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:44.016028 4728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:44.016278 4728 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [term 1 LEADER]: Becoming Leader. State: Replica: cbab8dec328c471b8001b2c9b672c081, State: Running, Role: LEADER
I20260809 02:01:44.016647 4728 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } }
I20260809 02:01:44.017109 4717 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:44.018369 4729 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbab8dec328c471b8001b2c9b672c081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } } }
I20260809 02:01:44.018431 4730 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbab8dec328c471b8001b2c9b672c081. Latest consensus state: current_term: 1 leader_uuid: "cbab8dec328c471b8001b2c9b672c081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbab8dec328c471b8001b2c9b672c081" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38105 } } }
I20260809 02:01:44.018513 4729 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:44.018534 4730 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:44.019205 4737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:44.021909 4737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:44.026830 4737 catalog_manager.cc:1347] Generated new cluster ID: 9d64091a542e40d5b14389836db7d24a
I20260809 02:01:44.026897 4737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:44.035290 4737 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:44.035590 4737 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:44.047719 4737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbab8dec328c471b8001b2c9b672c081: Generated new TSK 0
I20260809 02:01:44.048548 4737 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:44.062162 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4647
2026-08-09T02:01:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:44 dist-test-slave-2w3w krb5kdc[4749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:44 dist-test-slave-2w3w krb5kdc[4749](info): set up 2 sockets
Aug 09 02:01:44 dist-test-slave-2w3w krb5kdc[4749](info): commencing operation
krb5kdc: starting...
W20260809 02:01:45.156479 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:45.281442 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34227
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:45.388700 4764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:45.388948 4764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:45.388995 4764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:45.393013 4764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:45.393064 4764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:45.393083 4764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:45.393100 4764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:45.393138 4764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:45.398185 4764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:45.399232 4764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:45.400200 4764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:45.408608 4771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:45.408746 4764 server_base.cc:1034] running on GCE node
W20260809 02:01:45.408614 4773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:45.408596 4770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:45.409545 4764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:45.410614 4764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:45.411798 4764 hybrid_clock.cc:648] HybridClock initialized: now 1786240905411787 us; error 28 us; skew 500 ppm
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240905, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:45.419883 4764 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:45.420840 4764 webserver.cc:460] Webserver started at http://127.0.0.1:35499/ using document root <none> and password file <none>
I20260809 02:01:45.421409 4764 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:45.421500 4764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:45.421746 4764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:45.423882 4764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "0b461478a7c64573ad515962b5cf7783"
format_stamp: "Formatted at 2026-08-09 02:01:45 on dist-test-slave-2w3w"
server_key: "c3ef5fcbd3347b99e996acdc70bc7d6f"
server_key_iv: "fd40493fd6d2ec405f63c765a256d84f"
server_key_version: "encryptionkey@0"
I20260809 02:01:45.424453 4764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "0b461478a7c64573ad515962b5cf7783"
format_stamp: "Formatted at 2026-08-09 02:01:45 on dist-test-slave-2w3w"
server_key: "c3ef5fcbd3347b99e996acdc70bc7d6f"
server_key_iv: "fd40493fd6d2ec405f63c765a256d84f"
server_key_version: "encryptionkey@0"
I20260809 02:01:45.428134 4764 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:01:45.430464 4781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:45.431659 4764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:01:45.431797 4764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "0b461478a7c64573ad515962b5cf7783"
format_stamp: "Formatted at 2026-08-09 02:01:45 on dist-test-slave-2w3w"
server_key: "c3ef5fcbd3347b99e996acdc70bc7d6f"
server_key_iv: "fd40493fd6d2ec405f63c765a256d84f"
server_key_version: "encryptionkey@0"
I20260809 02:01:45.431903 4764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:45.455962 4764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:45.458913 4764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:45.459144 4764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:45.466547 4764 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34227
I20260809 02:01:45.466580 4835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34227 every 8 connection(s)
I20260809 02:01:45.467492 4764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:45.467862 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4764
I20260809 02:01:45.468021 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:45.468339 15039 external_mini_cluster.cc:1428] Setting key e9c575e1f91e51b3c3bc86f65a965745
I20260809 02:01:45.470299 4836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:45.475667 4836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783: Bootstrap starting.
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:01:45.477772 4836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:45.478482 4836 log.cc:824] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:45.480345 4836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783: No bootstrap required, opened a new log
I20260809 02:01:45.482342 4839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:45.469720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58933 (local address 127.0.0.1:34227)
0809 02:01:45.470130 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:45.470154 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:45.470201 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:01:45.470887 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:45.470904 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:45.471298 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:45.471622 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:45.472469 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:45.473468 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:45.474331 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:45.474796 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:45.474960 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:45.477501 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:45.477507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:45.477518 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:45.477544 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:45.479550 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:45.480011 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:45.480015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:45.480019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:45.480124 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:45.480420 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:45.480423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:45.480425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:45.480851 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:45.481066 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:45.481357 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 02:01:45.481641 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":133,"threads_started":1}
I20260809 02:01:45.484066 4836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } }
I20260809 02:01:45.484336 4836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:45.484416 4836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b461478a7c64573ad515962b5cf7783, State: Initialized, Role: FOLLOWER
I20260809 02:01:45.484845 4836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } }
I20260809 02:01:45.485000 4836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:45.485090 4836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:45.485210 4836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:45.485280 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:45.486402 4836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } }
I20260809 02:01:45.486795 4836 leader_election.cc:302] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b461478a7c64573ad515962b5cf7783; no voters:
I20260809 02:01:45.487138 4836 leader_election.cc:288] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:45.487252 4846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:45.487533 4846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [term 1 LEADER]: Becoming Leader. State: Replica: 0b461478a7c64573ad515962b5cf7783, State: Running, Role: LEADER
I20260809 02:01:45.487911 4846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } }
I20260809 02:01:45.488457 4836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:45.489490 4849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b461478a7c64573ad515962b5cf7783. Latest consensus state: current_term: 1 leader_uuid: "0b461478a7c64573ad515962b5cf7783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } } }
I20260809 02:01:45.489617 4849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:45.490036 4848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b461478a7c64573ad515962b5cf7783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b461478a7c64573ad515962b5cf7783" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34227 } } }
I20260809 02:01:45.490188 4848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:45.491187 4857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:45.494055 4857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:45.497102 4839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:45.487882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35635 (local address 127.0.0.1:34227)
0809 02:01:45.487991 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:45.487996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:45.488013 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:01:45.488169 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:45.488172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:45.488217 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:45.488267 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:45.489369 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:45.490346 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:45.491405 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:45.491760 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:45.491876 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:45.493561 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:45.493564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:45.493567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:45.493591 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:45.495343 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:45.495832 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:45.495835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:45.495837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:45.495923 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:45.496233 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:45.496236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:45.496238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:45.496415 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:45.496554 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:45.496787 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 02:01:45.496918 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":38}
I20260809 02:01:45.499953 4857 catalog_manager.cc:1347] Generated new cluster ID: f9d4faa79e2c4160a7038368b0afe652
I20260809 02:01:45.500025 4857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:45.522074 4857 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:45.523041 4857 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:45.530941 4857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b461478a7c64573ad515962b5cf7783: Generated new TSK 0
I20260809 02:01:45.531635 4857 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:45.537309 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4764
2026-08-09T02:01:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4870](info): set up 2 sockets
Aug 09 02:01:45 dist-test-slave-2w3w krb5kdc[4870](info): commencing operation
krb5kdc: starting...
W20260809 02:01:46.608458 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:46 dist-test-slave-2w3w krb5kdc[4870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:46.729856 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35637
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:46.837604 4883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:46.837895 4883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:46.837988 4883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:46.841972 4883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:46.842058 4883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:46.842097 4883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:46.842156 4883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:46.842197 4883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:46.847436 4883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:46.848441 4883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:46.849421 4883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:46.857908 4890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:46.857916 4891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:46.857925 4893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:46.858299 4883 server_base.cc:1034] running on GCE node
I20260809 02:01:46.858852 4883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:46.859892 4883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:46.861056 4883 hybrid_clock.cc:648] HybridClock initialized: now 1786240906861038 us; error 29 us; skew 500 ppm
Aug 09 02:01:46 dist-test-slave-2w3w krb5kdc[4870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240906, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:46.863766 4883 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:46.864602 4883 webserver.cc:460] Webserver started at http://127.0.0.1:43711/ using document root <none> and password file <none>
I20260809 02:01:46.865093 4883 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:46.865154 4883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:46.865357 4883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:46.867408 4883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "d880039fed47490d8ea5ea71f8fa9633"
format_stamp: "Formatted at 2026-08-09 02:01:46 on dist-test-slave-2w3w"
server_key: "467cba753c5419082cc14a8b06957971"
server_key_iv: "ede081e427b26e3a8ae6d4ba99e6a980"
server_key_version: "encryptionkey@0"
I20260809 02:01:46.867978 4883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "d880039fed47490d8ea5ea71f8fa9633"
format_stamp: "Formatted at 2026-08-09 02:01:46 on dist-test-slave-2w3w"
server_key: "467cba753c5419082cc14a8b06957971"
server_key_iv: "ede081e427b26e3a8ae6d4ba99e6a980"
server_key_version: "encryptionkey@0"
I20260809 02:01:46.872762 4883 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:01:46.875169 4900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:46.876380 4883 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:46.876533 4883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "d880039fed47490d8ea5ea71f8fa9633"
format_stamp: "Formatted at 2026-08-09 02:01:46 on dist-test-slave-2w3w"
server_key: "467cba753c5419082cc14a8b06957971"
server_key_iv: "ede081e427b26e3a8ae6d4ba99e6a980"
server_key_version: "encryptionkey@0"
I20260809 02:01:46.876645 4883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:46.900022 4883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:46.902902 4883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:46.903139 4883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:46.910421 4883 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35637
I20260809 02:01:46.910449 4955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35637 every 8 connection(s)
I20260809 02:01:46.911358 4883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:46.914021 4956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:46.916136 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 4883
I20260809 02:01:46.916285 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:46.916589 15039 external_mini_cluster.cc:1428] Setting key 6c56905f167e332206eb60a12cbf535b
I20260809 02:01:46.920583 4956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633: Bootstrap starting.
I20260809 02:01:46.923156 4956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:46.924026 4956 log.cc:824] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:46.925987 4956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633: No bootstrap required, opened a new log
I20260809 02:01:46.926618 4960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:46.917951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46571 (local address 127.0.0.1:35637)
0809 02:01:46.918404 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:46.918425 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:46.918468 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:01:46.919478 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:46.919502 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:46.919953 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:46.920308 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:46.920702 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:46.922175 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:46.923132 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:46.923812 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:46.924006 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:46.924898 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:46.924907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:46.924924 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:46.925293 (+ 369us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:46.925347 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:46.925370 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:46.925490 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:46.925606 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 02:01:46.925815 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":113,"threads_started":1}
I20260809 02:01:46.929404 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:46.929687 4956 raft_consensus.cc:348] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } }
I20260809 02:01:46.929916 4956 raft_consensus.cc:374] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:46.930003 4956 raft_consensus.cc:729] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d880039fed47490d8ea5ea71f8fa9633, State: Initialized, Role: FOLLOWER
I20260809 02:01:46.930451 4956 consensus_queue.cc:260] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } }
I20260809 02:01:46.930620 4956 raft_consensus.cc:388] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:46.930692 4956 raft_consensus.cc:482] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:46.930814 4956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:46.931893 4956 raft_consensus.cc:504] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } }
I20260809 02:01:46.932269 4956 leader_election.cc:302] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d880039fed47490d8ea5ea71f8fa9633; no voters:
I20260809 02:01:46.932643 4956 leader_election.cc:288] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:46.932710 4968 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:46.932915 4968 raft_consensus.cc:686] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [term 1 LEADER]: Becoming Leader. State: Replica: d880039fed47490d8ea5ea71f8fa9633, State: Running, Role: LEADER
I20260809 02:01:46.933243 4968 consensus_queue.cc:237] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } }
I20260809 02:01:46.933852 4956 sys_catalog.cc:564] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:46.934366 4968 sys_catalog.cc:455] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d880039fed47490d8ea5ea71f8fa9633. Latest consensus state: current_term: 1 leader_uuid: "d880039fed47490d8ea5ea71f8fa9633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } } }
I20260809 02:01:46.935204 4968 sys_catalog.cc:458] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:46.935076 4969 sys_catalog.cc:455] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d880039fed47490d8ea5ea71f8fa9633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d880039fed47490d8ea5ea71f8fa9633" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35637 } } }
I20260809 02:01:46.935523 4969 sys_catalog.cc:458] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:46.936312 4960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:46.931613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45655 (local address 127.0.0.1:35637)
0809 02:01:46.931730 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:46.931733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:46.931878 (+ 145us) server_negotiation.cc:407] Connection header received
0809 02:01:46.932036 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:46.932040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:46.932092 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:46.932149 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:46.932445 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:46.933138 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:46.934063 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:46.934332 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:46.934432 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:46.935443 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:46.935446 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:46.935449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:46.935462 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:46.935489 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:46.935501 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:46.935587 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:46.936096 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 02:01:46.936150 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:01:46.937105 4978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:46.940158 4978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:46.945048 4978 catalog_manager.cc:1347] Generated new cluster ID: f1f34bfa3d5c49d387be9c851bc40cec
I20260809 02:01:46.945113 4978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:46.952073 4978 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:46.952910 4978 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:46.958112 4978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d880039fed47490d8ea5ea71f8fa9633: Generated new TSK 0
I20260809 02:01:46.958694 4978 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:46.967154 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 4883
2026-08-09T02:01:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1429 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:47 dist-test-slave-2w3w krb5kdc[4991](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:47 dist-test-slave-2w3w krb5kdc[4991](info): set up 2 sockets
Aug 09 02:01:47 dist-test-slave-2w3w krb5kdc[4991](info): commencing operation
krb5kdc: starting...
W20260809 02:01:48.041064 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:48 dist-test-slave-2w3w krb5kdc[4991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:48.164357 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:48.270715 5005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:48.271030 5005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:48.271136 5005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:48.275110 5005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:48.275194 5005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:48.275233 5005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:48.275266 5005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:48.275295 5005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:48.280339 5005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:48.281308 5005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:48.282272 5005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:01:48.290446 5005 server_base.cc:1034] running on GCE node
W20260809 02:01:48.290395 5014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:48.290429 5011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:48.290361 5012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:48.291232 5005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:48.292215 5005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:48.293383 5005 hybrid_clock.cc:648] HybridClock initialized: now 1786240908293355 us; error 43 us; skew 500 ppm
Aug 09 02:01:48 dist-test-slave-2w3w krb5kdc[4991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240908, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:48.296211 5005 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:48.297063 5005 webserver.cc:460] Webserver started at http://127.0.0.1:37845/ using document root <none> and password file <none>
I20260809 02:01:48.297602 5005 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:48.297667 5005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:48.297873 5005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:48.299984 5005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "48f17bb6ab5a43e881562266ffb3bcf5"
format_stamp: "Formatted at 2026-08-09 02:01:48 on dist-test-slave-2w3w"
server_key: "8a92629899b76e7591a2795caeca2d50"
server_key_iv: "4c4fbb27ed705a1d96ce574bb67ef939"
server_key_version: "encryptionkey@0"
I20260809 02:01:48.300547 5005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "48f17bb6ab5a43e881562266ffb3bcf5"
format_stamp: "Formatted at 2026-08-09 02:01:48 on dist-test-slave-2w3w"
server_key: "8a92629899b76e7591a2795caeca2d50"
server_key_iv: "4c4fbb27ed705a1d96ce574bb67ef939"
server_key_version: "encryptionkey@0"
I20260809 02:01:48.304116 5005 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:01:48.306479 5021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:48.307662 5005 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:48.307803 5005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "48f17bb6ab5a43e881562266ffb3bcf5"
format_stamp: "Formatted at 2026-08-09 02:01:48 on dist-test-slave-2w3w"
server_key: "8a92629899b76e7591a2795caeca2d50"
server_key_iv: "4c4fbb27ed705a1d96ce574bb67ef939"
server_key_version: "encryptionkey@0"
I20260809 02:01:48.307915 5005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:48.312393 5005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:48.315227 5005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:48.315428 5005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:48.322361 5005 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37251
I20260809 02:01:48.322389 5080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37251 every 8 connection(s)
I20260809 02:01:48.323254 5005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:48.325814 5081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:48.330127 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5005
I20260809 02:01:48.330282 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:48.330590 15039 external_mini_cluster.cc:1428] Setting key a0b848b2b39d445fbb88537684e0077a
I20260809 02:01:48.331892 5081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5: Bootstrap starting.
I20260809 02:01:48.334590 5081 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:48.335553 5081 log.cc:824] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:48.336207 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:48.331988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49013 (local address 127.0.0.1:37251)
0809 02:01:48.332471 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:48.332491 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:48.332532 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:01:48.333393 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:48.333416 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:48.333745 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:48.334103 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:48.334936 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:48.334942 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:48.334981 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:48.334995 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:48.335059 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:48.335086 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:48.335200 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:48.335267 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 02:01:48.335413 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":106,"threads_started":1}
I20260809 02:01:48.337585 5081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5: No bootstrap required, opened a new log
I20260809 02:01:48.338869 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:48.341658 5081 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260809 02:01:48.341936 5081 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:48.342000 5081 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f17bb6ab5a43e881562266ffb3bcf5, State: Initialized, Role: FOLLOWER
I20260809 02:01:48.342466 5081 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260809 02:01:48.342633 5084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:48.340956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51935 (local address 127.0.0.1:37251)
0809 02:01:48.341088 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:48.341092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:48.341269 (+ 177us) server_negotiation.cc:407] Connection header received
0809 02:01:48.341387 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:48.341389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:48.341415 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:48.341477 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:48.342232 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:48.342236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:48.342238 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:48.342251 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:48.342280 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:48.342292 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:48.342376 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:48.342486 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 02:01:48.342515 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:01:48.342705 5081 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:48.342803 5081 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:48.342897 5081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:48.343883 5081 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260809 02:01:48.344154 5081 leader_election.cc:302] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48f17bb6ab5a43e881562266ffb3bcf5; no voters:
I20260809 02:01:48.344388 5081 leader_election.cc:288] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:48.344494 5092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:48.344741 5092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [term 1 LEADER]: Becoming Leader. State: Replica: 48f17bb6ab5a43e881562266ffb3bcf5, State: Running, Role: LEADER
I20260809 02:01:48.345081 5092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260809 02:01:48.345520 5081 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:48.346648 5093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } } }
I20260809 02:01:48.346786 5093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:48.347206 5102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:48.347157 5094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48f17bb6ab5a43e881562266ffb3bcf5. Latest consensus state: current_term: 1 leader_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48f17bb6ab5a43e881562266ffb3bcf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } } }
I20260809 02:01:48.347304 5094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:48.350064 5102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:48.354851 5102 catalog_manager.cc:1347] Generated new cluster ID: a1d74bc3d6aa4010aa830e02013ff6dc
I20260809 02:01:48.354912 5102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:48.366796 5102 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:48.367144 5102 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:48.380230 5102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48f17bb6ab5a43e881562266ffb3bcf5: Generated new TSK 0
I20260809 02:01:48.381016 5102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:48.386328 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5005
2026-08-09T02:01:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:48 dist-test-slave-2w3w krb5kdc[5114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:48 dist-test-slave-2w3w krb5kdc[5114](info): set up 2 sockets
Aug 09 02:01:48 dist-test-slave-2w3w krb5kdc[5114](info): commencing operation
krb5kdc: starting...
W20260809 02:01:49.464666 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:49.590281 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:49.700822 5127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:49.701083 5127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:49.701122 5127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:49.704974 5127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:49.705024 5127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:49.705042 5127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:49.705058 5127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:49.705073 5127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:49.710170 5127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:49.711125 5127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:49.712064 5127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:49.720435 5136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:49.720458 5132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:49.720587 5134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:49.720881 5127 server_base.cc:1034] running on GCE node
I20260809 02:01:49.721431 5127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:49.722481 5127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:49.723670 5127 hybrid_clock.cc:648] HybridClock initialized: now 1786240909723636 us; error 47 us; skew 500 ppm
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:49.726475 5127 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:49.727562 5127 webserver.cc:460] Webserver started at http://127.0.0.1:39975/ using document root <none> and password file <none>
I20260809 02:01:49.728166 5127 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:49.728276 5127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:49.728511 5127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:49.730710 5127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "17131eb22832418ab14e9d410bf4f690"
format_stamp: "Formatted at 2026-08-09 02:01:49 on dist-test-slave-2w3w"
server_key: "1e260687efcec9d7f5d1a1d205520b00"
server_key_iv: "40c8c340626d12a04df7e9645940a806"
server_key_version: "encryptionkey@0"
I20260809 02:01:49.731395 5127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "17131eb22832418ab14e9d410bf4f690"
format_stamp: "Formatted at 2026-08-09 02:01:49 on dist-test-slave-2w3w"
server_key: "1e260687efcec9d7f5d1a1d205520b00"
server_key_iv: "40c8c340626d12a04df7e9645940a806"
server_key_version: "encryptionkey@0"
I20260809 02:01:49.735423 5127 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:01:49.737901 5143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:49.739161 5127 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:49.739305 5127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "17131eb22832418ab14e9d410bf4f690"
format_stamp: "Formatted at 2026-08-09 02:01:49 on dist-test-slave-2w3w"
server_key: "1e260687efcec9d7f5d1a1d205520b00"
server_key_iv: "40c8c340626d12a04df7e9645940a806"
server_key_version: "encryptionkey@0"
I20260809 02:01:49.739414 5127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:49.752311 5127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:49.755203 5127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:49.755401 5127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:49.762544 5127 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36989
I20260809 02:01:49.762571 5197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36989 every 8 connection(s)
I20260809 02:01:49.763487 5127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:49.766108 5198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:49.767158 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5127
I20260809 02:01:49.767304 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:49.767643 15039 external_mini_cluster.cc:1428] Setting key 340c2cadc5e4e3fddffb8bf82f78212a
I20260809 02:01:49.772455 5198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690: Bootstrap starting.
I20260809 02:01:49.775079 5198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:49.775844 5198 log.cc:824] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:01:49.777765 5198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690: No bootstrap required, opened a new log
I20260809 02:01:49.781352 5198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } }
I20260809 02:01:49.781591 5198 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:49.781678 5198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17131eb22832418ab14e9d410bf4f690, State: Initialized, Role: FOLLOWER
I20260809 02:01:49.782019 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:49.768987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:36867 (local address 127.0.0.1:36989)
0809 02:01:49.769383 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:49.769398 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:49.769433 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:01:49.770082 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:49.770099 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:49.770418 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:49.770695 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:49.771648 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:49.772664 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:49.773839 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:49.774297 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:49.774416 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:49.777198 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:49.777203 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:49.777216 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:49.777241 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:49.778949 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:49.779521 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:49.779531 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:49.779535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:49.779644 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:49.780019 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:49.780021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:49.780022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:49.780380 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:49.780623 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:49.780957 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 02:01:49.781173 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":130,"threads_started":1}
I20260809 02:01:49.782090 5198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } }
I20260809 02:01:49.782261 5198 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:49.782346 5198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:49.782450 5198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:49.783505 5198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } }
I20260809 02:01:49.783862 5198 leader_election.cc:302] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17131eb22832418ab14e9d410bf4f690; no voters:
I20260809 02:01:49.784204 5198 leader_election.cc:288] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:49.784276 5203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:49.784497 5203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [term 1 LEADER]: Becoming Leader. State: Replica: 17131eb22832418ab14e9d410bf4f690, State: Running, Role: LEADER
I20260809 02:01:49.784828 5203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } }
I20260809 02:01:49.785043 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:49.785454 5198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:49.786773 5205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17131eb22832418ab14e9d410bf4f690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } } }
I20260809 02:01:49.786893 5205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:49.787292 5204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17131eb22832418ab14e9d410bf4f690. Latest consensus state: current_term: 1 leader_uuid: "17131eb22832418ab14e9d410bf4f690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17131eb22832418ab14e9d410bf4f690" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36989 } } }
I20260809 02:01:49.787523 5204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:49.787302 5217 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:49.790560 5217 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:49.796692 5217 catalog_manager.cc:1347] Generated new cluster ID: 3b27690777bb4974872b30cd6b81bc92
I20260809 02:01:49.796818 5217 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:49.798216 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:49.787670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:34421 (local address 127.0.0.1:36989)
0809 02:01:49.787898 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:49.787903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:49.788301 (+ 398us) server_negotiation.cc:407] Connection header received
0809 02:01:49.788491 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:49.788494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:49.788555 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:49.788596 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:49.789502 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:49.790352 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:49.791573 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:49.791919 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:49.792029 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:49.793964 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:49.793967 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:49.793970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:49.793997 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:49.796114 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:49.796713 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:49.796717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:49.796719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:49.796812 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:49.797265 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:49.797269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:49.797271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:49.797515 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:49.797676 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:49.797977 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 02:01:49.798071 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260809 02:01:49.815081 5217 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:49.816224 5217 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:49.827857 5217 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17131eb22832418ab14e9d410bf4f690: Generated new TSK 0
I20260809 02:01:49.828625 5217 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:49.834537 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5127
W20260809 02:01:49.842092 5112 connection.cc:535] client connection to 127.0.0.1:36989 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36989): Connection reset by peer (error 104)
2026-08-09T02:01:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5232](info): set up 2 sockets
Aug 09 02:01:49 dist-test-slave-2w3w krb5kdc[5232](info): commencing operation
krb5kdc: starting...
W20260809 02:01:50.909487 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:50 dist-test-slave-2w3w krb5kdc[5232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:51.037403 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:51.150255 5246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:51.150506 5246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:51.150547 5246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:51.154505 5246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:51.154562 5246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:51.154582 5246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:51.154597 5246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:51.154613 5246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:51.159680 5246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:51.160583 5246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:51.161510 5246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:51.169732 5252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:51.169742 5251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:51.169727 5254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:51.170079 5246 server_base.cc:1034] running on GCE node
I20260809 02:01:51.170665 5246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:51.171793 5246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:51.172988 5246 hybrid_clock.cc:648] HybridClock initialized: now 1786240911172965 us; error 43 us; skew 500 ppm
Aug 09 02:01:51 dist-test-slave-2w3w krb5kdc[5232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240911, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:51.179598 5246 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:51.180450 5246 webserver.cc:460] Webserver started at http://127.0.0.1:34461/ using document root <none> and password file <none>
I20260809 02:01:51.180990 5246 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:51.181082 5246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:51.181324 5246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:51.183378 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "dbaef7847f80439fb0cec9940c5ed770"
format_stamp: "Formatted at 2026-08-09 02:01:51 on dist-test-slave-2w3w"
server_key: "b0d742ddc26aa0a8329a88d7aff287de"
server_key_iv: "4180254624d4519bcdc42cb87dc49908"
server_key_version: "encryptionkey@0"
I20260809 02:01:51.183935 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "dbaef7847f80439fb0cec9940c5ed770"
format_stamp: "Formatted at 2026-08-09 02:01:51 on dist-test-slave-2w3w"
server_key: "b0d742ddc26aa0a8329a88d7aff287de"
server_key_iv: "4180254624d4519bcdc42cb87dc49908"
server_key_version: "encryptionkey@0"
I20260809 02:01:51.187495 5246 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:01:51.189854 5261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:51.191080 5246 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:51.191215 5246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "dbaef7847f80439fb0cec9940c5ed770"
format_stamp: "Formatted at 2026-08-09 02:01:51 on dist-test-slave-2w3w"
server_key: "b0d742ddc26aa0a8329a88d7aff287de"
server_key_iv: "4180254624d4519bcdc42cb87dc49908"
server_key_version: "encryptionkey@0"
I20260809 02:01:51.191351 5246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:51.202159 5246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:51.205279 5246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:51.205487 5246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:51.212565 5246 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40821
I20260809 02:01:51.212639 5315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40821 every 8 connection(s)
I20260809 02:01:51.213822 5246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:51.214727 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5246
I20260809 02:01:51.214910 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:51.215323 15039 external_mini_cluster.cc:1428] Setting key 9afd68f7e8408a8218b0a2fd85d8adf4
I20260809 02:01:51.217598 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:51.225878 5316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: Bootstrap starting.
I20260809 02:01:51.228111 5316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:51.228961 5316 log.cc:824] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:51.231144 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:51.217044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:44747 (local address 127.0.0.1:40821)
0809 02:01:51.217642 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:51.217664 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:51.223355 (+ 5691us) server_negotiation.cc:407] Connection header received
0809 02:01:51.224364 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:51.224383 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:51.224714 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:51.225036 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:51.225431 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:51.226479 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:51.227459 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:51.227920 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:51.228087 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:51.229066 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:51.229073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:51.229089 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:51.229695 (+ 606us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:51.229773 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:51.229808 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:51.229962 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:51.230212 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 02:01:51.230364 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":195,"threads_started":1}
I20260809 02:01:51.231232 5316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: No bootstrap required, opened a new log
I20260809 02:01:51.233824 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:51.235031 5316 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } }
I20260809 02:01:51.235337 5316 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:51.235400 5316 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbaef7847f80439fb0cec9940c5ed770, State: Initialized, Role: FOLLOWER
I20260809 02:01:51.235848 5316 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } }
I20260809 02:01:51.236030 5316 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:51.236109 5316 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:51.236284 5316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:51.237385 5316 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } }
I20260809 02:01:51.237757 5316 leader_election.cc:302] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbaef7847f80439fb0cec9940c5ed770; no voters:
I20260809 02:01:51.238097 5316 leader_election.cc:288] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:51.238205 5326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:51.238456 5326 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [term 1 LEADER]: Becoming Leader. State: Replica: dbaef7847f80439fb0cec9940c5ed770, State: Running, Role: LEADER
I20260809 02:01:51.238809 5326 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } }
I20260809 02:01:51.239379 5316 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:51.240033 5326 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbaef7847f80439fb0cec9940c5ed770. Latest consensus state: current_term: 1 leader_uuid: "dbaef7847f80439fb0cec9940c5ed770" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } } }
I20260809 02:01:51.240846 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:51.236103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42531 (local address 127.0.0.1:40821)
0809 02:01:51.236215 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:51.236219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:51.236422 (+ 203us) server_negotiation.cc:407] Connection header received
0809 02:01:51.236633 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:51.236636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:51.236675 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:51.236733 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:51.237046 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:51.237598 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:51.238719 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:51.239093 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:51.239199 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:51.240165 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:51.240170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:51.240173 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:51.240185 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:51.240214 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:51.240230 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:51.240297 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:51.240616 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 02:01:51.240659 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":32}
I20260809 02:01:51.241057 5326 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:51.240694 5328 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbaef7847f80439fb0cec9940c5ed770" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbaef7847f80439fb0cec9940c5ed770" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40821 } } }
I20260809 02:01:51.241394 5328 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770 [sys.catalog]: This master's current role is: LEADER
W20260809 02:01:51.244338 5342 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:01:51.244427 5342 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:01:51.244498 5337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:51.245177 5337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:51.250491 5337 catalog_manager.cc:1347] Generated new cluster ID: 89e86d67fe3f41ec9169d3312d6642f0
I20260809 02:01:51.250552 5337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:51.255389 5337 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:51.256554 5337 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:51.266516 5337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbaef7847f80439fb0cec9940c5ed770: Generated new TSK 0
I20260809 02:01:51.267340 5337 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:51.277889 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5246
W20260809 02:01:51.283438 5229 connection.cc:535] client connection to 127.0.0.1:40821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40821): Connection reset by peer (error 104)
2026-08-09T02:01:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:51 dist-test-slave-2w3w krb5kdc[5348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:51 dist-test-slave-2w3w krb5kdc[5348](info): set up 2 sockets
Aug 09 02:01:51 dist-test-slave-2w3w krb5kdc[5348](info): commencing operation
krb5kdc: starting...
W20260809 02:01:52.348402 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:52 dist-test-slave-2w3w krb5kdc[5348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:52.474629 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38323
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:52.584939 5361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:52.585230 5361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:52.585302 5361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:52.589282 5361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:52.589390 5361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:52.589430 5361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:52.589468 5361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:52.589501 5361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:52.594666 5361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:52.595750 5361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:52.596765 5361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:52.604957 5367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:52.604897 5370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:52.604907 5366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:52.605159 5361 server_base.cc:1034] running on GCE node
I20260809 02:01:52.605788 5361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:52.606802 5361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:52.607965 5361 hybrid_clock.cc:648] HybridClock initialized: now 1786240912607948 us; error 29 us; skew 500 ppm
Aug 09 02:01:52 dist-test-slave-2w3w krb5kdc[5348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240912, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:52.610643 5361 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:52.611542 5361 webserver.cc:460] Webserver started at http://127.0.0.1:37335/ using document root <none> and password file <none>
I20260809 02:01:52.612083 5361 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:52.612145 5361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:52.612381 5361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:52.614362 5361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "a57b906bd1fe4356b2fa02dd06778db4"
format_stamp: "Formatted at 2026-08-09 02:01:52 on dist-test-slave-2w3w"
server_key: "824761c72ecd670291d87d7e4548a2ad"
server_key_iv: "db4844223884c95159be7ab1a4a62071"
server_key_version: "encryptionkey@0"
I20260809 02:01:52.614938 5361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "a57b906bd1fe4356b2fa02dd06778db4"
format_stamp: "Formatted at 2026-08-09 02:01:52 on dist-test-slave-2w3w"
server_key: "824761c72ecd670291d87d7e4548a2ad"
server_key_iv: "db4844223884c95159be7ab1a4a62071"
server_key_version: "encryptionkey@0"
I20260809 02:01:52.618479 5361 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:01:52.620810 5377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:52.621938 5361 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:01:52.622084 5361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "a57b906bd1fe4356b2fa02dd06778db4"
format_stamp: "Formatted at 2026-08-09 02:01:52 on dist-test-slave-2w3w"
server_key: "824761c72ecd670291d87d7e4548a2ad"
server_key_iv: "db4844223884c95159be7ab1a4a62071"
server_key_version: "encryptionkey@0"
I20260809 02:01:52.622192 5361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:52.626600 5361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:52.629366 5361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:52.629597 5361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:52.636610 5361 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38323
I20260809 02:01:52.636648 5433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38323 every 8 connection(s)
I20260809 02:01:52.637486 5361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:52.640120 5434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:52.641019 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5361
I20260809 02:01:52.641175 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:52.641479 15039 external_mini_cluster.cc:1428] Setting key a86d4bed04e74d28bbf257546f628887
I20260809 02:01:52.646757 5434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4: Bootstrap starting.
I20260809 02:01:52.646940 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:52.642821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:48633 (local address 127.0.0.1:38323)
0809 02:01:52.643275 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:52.643293 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:52.643346 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:01:52.644166 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:52.644188 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:52.644526 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:52.644881 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:52.645600 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:52.645605 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:52.645620 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:52.645633 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:52.645698 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:52.645724 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:52.645872 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:52.645940 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:01:52.646084 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":172,"threads_started":1}
I20260809 02:01:52.649293 5434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:52.649680 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:52.650133 5434 log.cc:824] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:52.652208 5434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4: No bootstrap required, opened a new log
I20260809 02:01:52.655694 5434 raft_consensus.cc:348] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } }
I20260809 02:01:52.655936 5434 raft_consensus.cc:374] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:52.656015 5434 raft_consensus.cc:729] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a57b906bd1fe4356b2fa02dd06778db4, State: Initialized, Role: FOLLOWER
I20260809 02:01:52.656512 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:52.651884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:33095 (local address 127.0.0.1:38323)
0809 02:01:52.651992 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:52.651995 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:52.655229 (+ 3234us) server_negotiation.cc:407] Connection header received
0809 02:01:52.655299 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:52.655302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:52.655343 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:52.655428 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:52.656127 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:52.656130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:52.656133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:52.656144 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:52.656170 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:52.656188 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:52.656280 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:52.656356 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:01:52.656396 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:01:52.656488 5434 consensus_queue.cc:260] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } }
I20260809 02:01:52.656666 5434 raft_consensus.cc:388] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:52.656737 5434 raft_consensus.cc:482] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:52.656842 5434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:52.657832 5434 raft_consensus.cc:504] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } }
I20260809 02:01:52.658103 5434 leader_election.cc:302] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a57b906bd1fe4356b2fa02dd06778db4; no voters:
I20260809 02:01:52.658330 5434 leader_election.cc:288] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:52.658443 5445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:52.658720 5445 raft_consensus.cc:686] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [term 1 LEADER]: Becoming Leader. State: Replica: a57b906bd1fe4356b2fa02dd06778db4, State: Running, Role: LEADER
I20260809 02:01:52.659106 5445 consensus_queue.cc:237] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } }
I20260809 02:01:52.659483 5434 sys_catalog.cc:564] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:52.660873 5446 sys_catalog.cc:455] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a57b906bd1fe4356b2fa02dd06778db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } } }
I20260809 02:01:52.661001 5446 sys_catalog.cc:458] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:52.661347 5447 sys_catalog.cc:455] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a57b906bd1fe4356b2fa02dd06778db4. Latest consensus state: current_term: 1 leader_uuid: "a57b906bd1fe4356b2fa02dd06778db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57b906bd1fe4356b2fa02dd06778db4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38323 } } }
I20260809 02:01:52.661468 5455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:52.662561 5447 sys_catalog.cc:458] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:52.665331 5455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:52.670001 5455 catalog_manager.cc:1347] Generated new cluster ID: 1231aa38ab1644bfae367b071b24a80f
I20260809 02:01:52.670066 5455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:52.682880 5455 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:52.683228 5455 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:52.687599 5455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a57b906bd1fe4356b2fa02dd06778db4: Generated new TSK 0
I20260809 02:01:52.688170 5455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:52.692343 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5361
2026-08-09T02:01:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:52 dist-test-slave-2w3w krb5kdc[5466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:52 dist-test-slave-2w3w krb5kdc[5466](info): set up 2 sockets
Aug 09 02:01:52 dist-test-slave-2w3w krb5kdc[5466](info): commencing operation
krb5kdc: starting...
W20260809 02:01:53.765239 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:53 dist-test-slave-2w3w krb5kdc[5466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:53.888257 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39543
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:53.997568 5480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:53.997841 5480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:53.997917 5480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:54.001843 5480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:54.001935 5480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:54.001974 5480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:54.002033 5480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:54.002072 5480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:54.007237 5480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39543
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:54.008210 5480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:54.009171 5480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:54.017587 5489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:54.017572 5485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:54.017593 5487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:54.017756 5480 server_base.cc:1034] running on GCE node
I20260809 02:01:54.018359 5480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:54.019407 5480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:54.020640 5480 hybrid_clock.cc:648] HybridClock initialized: now 1786240914020616 us; error 40 us; skew 500 ppm
Aug 09 02:01:54 dist-test-slave-2w3w krb5kdc[5466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240914, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:54.023447 5480 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:54.024314 5480 webserver.cc:460] Webserver started at http://127.0.0.1:36295/ using document root <none> and password file <none>
I20260809 02:01:54.024859 5480 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:54.024953 5480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:54.025180 5480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:54.027249 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "e1c0ae027ca94541bdefd75b9f54e681"
format_stamp: "Formatted at 2026-08-09 02:01:54 on dist-test-slave-2w3w"
server_key: "d2ef81f9a575596229257c0caf7d8288"
server_key_iv: "396b7d83b34c92a899c0dee13b4a5fd8"
server_key_version: "encryptionkey@0"
I20260809 02:01:54.027827 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "e1c0ae027ca94541bdefd75b9f54e681"
format_stamp: "Formatted at 2026-08-09 02:01:54 on dist-test-slave-2w3w"
server_key: "d2ef81f9a575596229257c0caf7d8288"
server_key_iv: "396b7d83b34c92a899c0dee13b4a5fd8"
server_key_version: "encryptionkey@0"
I20260809 02:01:54.031430 5480 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:01:54.033694 5496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:54.034911 5480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:54.035102 5480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "e1c0ae027ca94541bdefd75b9f54e681"
format_stamp: "Formatted at 2026-08-09 02:01:54 on dist-test-slave-2w3w"
server_key: "d2ef81f9a575596229257c0caf7d8288"
server_key_iv: "396b7d83b34c92a899c0dee13b4a5fd8"
server_key_version: "encryptionkey@0"
I20260809 02:01:54.035202 5480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:54.056175 5480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:54.059090 5480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:54.059302 5480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:54.066757 5480 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39543
I20260809 02:01:54.066787 5552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39543 every 8 connection(s)
I20260809 02:01:54.067742 5480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:54.070328 5553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:54.074569 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5480
I20260809 02:01:54.074705 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:54.075078 15039 external_mini_cluster.cc:1428] Setting key f8c5abd38f5f7348030f56268557a8a2
I20260809 02:01:54.076125 5553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681: Bootstrap starting.
I20260809 02:01:54.078303 5553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:54.079075 5553 log.cc:824] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:54.080840 5553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681: No bootstrap required, opened a new log
Aug 09 02:01:54 dist-test-slave-2w3w krb5kdc[5466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:01:54.084903 5553 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } }
I20260809 02:01:54.085175 5553 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:54.085294 5553 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c0ae027ca94541bdefd75b9f54e681, State: Initialized, Role: FOLLOWER
I20260809 02:01:54.085800 5553 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } }
I20260809 02:01:54.085927 5553 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:54.086014 5553 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:54.086134 5553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:54.087072 5553 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } }
I20260809 02:01:54.087442 5553 leader_election.cc:302] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c0ae027ca94541bdefd75b9f54e681; no voters:
I20260809 02:01:54.087759 5553 leader_election.cc:288] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:54.087913 5559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:54.088249 5559 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [term 1 LEADER]: Becoming Leader. State: Replica: e1c0ae027ca94541bdefd75b9f54e681, State: Running, Role: LEADER
I20260809 02:01:54.088570 5559 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } }
I20260809 02:01:54.089044 5553 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:54.089978 5559 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c0ae027ca94541bdefd75b9f54e681. Latest consensus state: current_term: 1 leader_uuid: "e1c0ae027ca94541bdefd75b9f54e681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } } }
I20260809 02:01:54.090157 5559 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:54.090245 5557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:54.076528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:48767 (local address 127.0.0.1:39543)
0809 02:01:54.076959 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:54.076973 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:54.077007 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:01:54.077607 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:54.077622 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:54.077944 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:54.078270 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:54.079197 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:54.080205 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:54.081115 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:54.081595 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:54.081761 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:54.084684 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:54.084690 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:54.084701 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:54.084727 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:54.086710 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:54.087352 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:54.087357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:54.087361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:54.087480 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:54.087949 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:54.087953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:54.087954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:54.088512 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:54.088749 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:54.089091 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 02:01:54.089312 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":118,"threads_started":1}
I20260809 02:01:54.090425 5560 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c0ae027ca94541bdefd75b9f54e681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c0ae027ca94541bdefd75b9f54e681" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39543 } } }
I20260809 02:01:54.090545 5560 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:54.090592 5568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:54.093590 5568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:54.093835 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:54.100358 5568 catalog_manager.cc:1347] Generated new cluster ID: 94548d0a888e43f5bbf156ba7977d4d7
I20260809 02:01:54.100416 5568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:54.105444 5557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:54.096491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:39073 (local address 127.0.0.1:39543)
0809 02:01:54.096609 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:54.096613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:54.096628 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:01:54.096721 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:54.096724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:54.096762 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:54.096859 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:54.097505 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:54.098218 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:54.099522 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:54.099875 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:54.099980 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:54.101768 (+ 1788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:54.101771 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:54.101774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:54.101797 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:54.103528 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:54.104121 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:54.104124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:54.104125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:54.104204 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:54.104570 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:54.104573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:54.104575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:54.104759 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:54.104908 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:54.105201 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 02:01:54.105292 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:01:54.109222 5568 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:54.110213 5568 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:54.116501 5568 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1c0ae027ca94541bdefd75b9f54e681: Generated new TSK 0
I20260809 02:01:54.117244 5568 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:54.125993 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5480
W20260809 02:01:54.133589 5464 connection.cc:535] client connection to 127.0.0.1:39543 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39543): Connection reset by peer (error 104)
2026-08-09T02:01:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:54 dist-test-slave-2w3w krb5kdc[5585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:54 dist-test-slave-2w3w krb5kdc[5585](info): set up 2 sockets
Aug 09 02:01:54 dist-test-slave-2w3w krb5kdc[5585](info): commencing operation
krb5kdc: starting...
W20260809 02:01:55.257555 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:55 dist-test-slave-2w3w krb5kdc[5585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:55.382324 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:55.491418 5598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:55.491727 5598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:55.491798 5598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:55.495857 5598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:55.495944 5598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:55.495982 5598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:55.496038 5598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:55.496079 5598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:55.501332 5598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36039
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:55.502385 5598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:55.503422 5598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:55.511889 5606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:55.511897 5603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:55.511896 5604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:55.511951 5598 server_base.cc:1034] running on GCE node
I20260809 02:01:55.512718 5598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:55.514091 5598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:55.515251 5598 hybrid_clock.cc:648] HybridClock initialized: now 1786240915515230 us; error 33 us; skew 500 ppm
Aug 09 02:01:55 dist-test-slave-2w3w krb5kdc[5585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240915, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:55.518026 5598 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:55.518882 5598 webserver.cc:460] Webserver started at http://127.0.0.1:45719/ using document root <none> and password file <none>
I20260809 02:01:55.519444 5598 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:55.519510 5598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:55.519671 5598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:55.521601 5598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "c367a50bd11d4592bd6271288b2d632e"
format_stamp: "Formatted at 2026-08-09 02:01:55 on dist-test-slave-2w3w"
server_key: "5526c4936e5e10dddc95fdda3d1dcf52"
server_key_iv: "7ab3584bce12235ad07009d0a13b3845"
server_key_version: "encryptionkey@0"
I20260809 02:01:55.522117 5598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "c367a50bd11d4592bd6271288b2d632e"
format_stamp: "Formatted at 2026-08-09 02:01:55 on dist-test-slave-2w3w"
server_key: "5526c4936e5e10dddc95fdda3d1dcf52"
server_key_iv: "7ab3584bce12235ad07009d0a13b3845"
server_key_version: "encryptionkey@0"
I20260809 02:01:55.525681 5598 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:01:55.528045 5614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:55.529223 5598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:55.529366 5598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "c367a50bd11d4592bd6271288b2d632e"
format_stamp: "Formatted at 2026-08-09 02:01:55 on dist-test-slave-2w3w"
server_key: "5526c4936e5e10dddc95fdda3d1dcf52"
server_key_iv: "7ab3584bce12235ad07009d0a13b3845"
server_key_version: "encryptionkey@0"
I20260809 02:01:55.529477 5598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:55.561246 5598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:55.564184 5598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:55.564409 5598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:55.571987 5598 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36039
I20260809 02:01:55.572013 5670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36039 every 8 connection(s)
I20260809 02:01:55.572923 5598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:55.575621 5671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:55.578891 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5598
I20260809 02:01:55.579066 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:55.579367 15039 external_mini_cluster.cc:1428] Setting key 7f0ceeb944743af7f6bfd7f01737e578
I20260809 02:01:55.581586 5671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e: Bootstrap starting.
I20260809 02:01:55.583777 5671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:55.584508 5671 log.cc:824] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:55.586648 5671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e: No bootstrap required, opened a new log
I20260809 02:01:55.589396 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:55.580812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:39821 (local address 127.0.0.1:36039)
0809 02:01:55.581253 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:55.581268 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:55.581302 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:01:55.581982 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:55.582000 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:55.582339 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:55.582680 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:55.583130 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:55.584158 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:55.585291 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:55.585966 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:55.586132 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:55.587084 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:55.587090 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:55.587106 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:55.587611 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:55.587681 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:55.587711 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:55.587843 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:55.588067 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 02:01:55.588204 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":132,"threads_started":1}
I20260809 02:01:55.590498 5671 raft_consensus.cc:348] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } }
I20260809 02:01:55.590771 5671 raft_consensus.cc:374] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:55.590833 5671 raft_consensus.cc:729] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c367a50bd11d4592bd6271288b2d632e, State: Initialized, Role: FOLLOWER
I20260809 02:01:55.591302 5671 consensus_queue.cc:260] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } }
I20260809 02:01:55.591464 5671 raft_consensus.cc:388] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:55.591539 5671 raft_consensus.cc:482] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:55.591666 5671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:55.592501 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:55.592887 5671 raft_consensus.cc:504] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } }
I20260809 02:01:55.593237 5671 leader_election.cc:302] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c367a50bd11d4592bd6271288b2d632e; no voters:
I20260809 02:01:55.593555 5671 leader_election.cc:288] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:55.593709 5676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:55.593940 5676 raft_consensus.cc:686] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [term 1 LEADER]: Becoming Leader. State: Replica: c367a50bd11d4592bd6271288b2d632e, State: Running, Role: LEADER
I20260809 02:01:55.594257 5676 consensus_queue.cc:237] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } }
I20260809 02:01:55.594882 5671 sys_catalog.cc:564] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:55.595523 5676 sys_catalog.cc:455] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c367a50bd11d4592bd6271288b2d632e. Latest consensus state: current_term: 1 leader_uuid: "c367a50bd11d4592bd6271288b2d632e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } } }
I20260809 02:01:55.595523 5679 sys_catalog.cc:455] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c367a50bd11d4592bd6271288b2d632e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c367a50bd11d4592bd6271288b2d632e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36039 } } }
I20260809 02:01:55.595695 5676 sys_catalog.cc:458] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:55.595770 5679 sys_catalog.cc:458] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:55.596217 5690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:55.599449 5690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:55.600067 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:55.594739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:32819 (local address 127.0.0.1:36039)
0809 02:01:55.594855 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:55.594860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:55.595172 (+ 312us) server_negotiation.cc:407] Connection header received
0809 02:01:55.595301 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:55.595304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:55.595354 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:55.595431 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:55.595896 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:55.596732 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:55.597989 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:55.598350 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:55.598460 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:55.599528 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:55.599532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:55.599535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:55.599550 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:55.599576 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:55.599589 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:55.599685 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:55.599900 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:01:55.599939 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:01:55.605293 5690 catalog_manager.cc:1347] Generated new cluster ID: f25a23f6b1bf48388a26d043400acdf9
I20260809 02:01:55.605357 5690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:55.620324 5690 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:55.621248 5690 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:55.628082 5690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c367a50bd11d4592bd6271288b2d632e: Generated new TSK 0
I20260809 02:01:55.628750 5690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:55.637420 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5598
W20260809 02:01:55.644114 5583 connection.cc:535] client connection to 127.0.0.1:36039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36039): Connection reset by peer (error 104)
2026-08-09T02:01:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:55 dist-test-slave-2w3w krb5kdc[5705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:55 dist-test-slave-2w3w krb5kdc[5705](info): set up 2 sockets
Aug 09 02:01:55 dist-test-slave-2w3w krb5kdc[5705](info): commencing operation
krb5kdc: starting...
W20260809 02:01:56.704263 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:56 dist-test-slave-2w3w krb5kdc[5705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:01:56.828121 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:56.937794 5720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:56.938033 5720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:56.938073 5720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:56.941931 5720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:56.941984 5720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:56.942004 5720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:56.942020 5720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:56.942035 5720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:56.947212 5720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42733
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:56.948149 5720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:56.949151 5720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:56.957762 5729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:56.957716 5726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:56.957702 5725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:56.958244 5720 server_base.cc:1034] running on GCE node
I20260809 02:01:56.958781 5720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:56.959987 5720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:56.961270 5720 hybrid_clock.cc:648] HybridClock initialized: now 1786240916961240 us; error 42 us; skew 500 ppm
Aug 09 02:01:56 dist-test-slave-2w3w krb5kdc[5705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240916, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:56.967085 5720 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:01:56.968091 5720 webserver.cc:460] Webserver started at http://127.0.0.1:43379/ using document root <none> and password file <none>
I20260809 02:01:56.968685 5720 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:56.968782 5720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:56.969034 5720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:56.971202 5720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "eaadf35fd34f4c228e11f26623f17c84"
format_stamp: "Formatted at 2026-08-09 02:01:56 on dist-test-slave-2w3w"
server_key: "da4a9f2c7edd59975ae8f3655a00b661"
server_key_iv: "df2f880e499702a4a629f144564bcc1c"
server_key_version: "encryptionkey@0"
I20260809 02:01:56.971782 5720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "eaadf35fd34f4c228e11f26623f17c84"
format_stamp: "Formatted at 2026-08-09 02:01:56 on dist-test-slave-2w3w"
server_key: "da4a9f2c7edd59975ae8f3655a00b661"
server_key_iv: "df2f880e499702a4a629f144564bcc1c"
server_key_version: "encryptionkey@0"
I20260809 02:01:56.975744 5720 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:01:56.978111 5736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:56.979382 5720 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:01:56.979530 5720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "eaadf35fd34f4c228e11f26623f17c84"
format_stamp: "Formatted at 2026-08-09 02:01:56 on dist-test-slave-2w3w"
server_key: "da4a9f2c7edd59975ae8f3655a00b661"
server_key_iv: "df2f880e499702a4a629f144564bcc1c"
server_key_version: "encryptionkey@0"
I20260809 02:01:56.979640 5720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:56.984251 5720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:56.987063 5720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:56.987246 5720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:56.994268 5720 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42733
I20260809 02:01:56.994297 5794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42733 every 8 connection(s)
I20260809 02:01:56.995280 5720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:56.997852 5795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:57.003149 5795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: Bootstrap starting.
I20260809 02:01:57.004637 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5720
I20260809 02:01:57.004796 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:57.005098 15039 external_mini_cluster.cc:1428] Setting key f060b50654f773bd70c2d94f702a9c4b
I20260809 02:01:57.005741 5795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:57.006560 5795 log.cc:824] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:57.008589 5795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: No bootstrap required, opened a new log
I20260809 02:01:57.010300 5798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:57.006194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:34349 (local address 127.0.0.1:42733)
0809 02:01:57.006702 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:57.006722 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:57.006771 (+ 49us) server_negotiation.cc:407] Connection header received
0809 02:01:57.007610 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:57.007628 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:57.007890 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:57.008171 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:57.009093 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:57.009098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:57.009109 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:57.009119 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:57.009171 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:57.009188 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:57.009273 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:57.009419 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:01:57.009613 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":185,"threads_started":1}
I20260809 02:01:57.012470 5795 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } }
I20260809 02:01:57.012706 5795 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:57.012782 5795 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaadf35fd34f4c228e11f26623f17c84, State: Initialized, Role: FOLLOWER
I20260809 02:01:57.012980 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:57.013260 5795 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } }
I20260809 02:01:57.013422 5795 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:57.013499 5795 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:57.013603 5795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:57.014876 5795 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } }
I20260809 02:01:57.015256 5795 leader_election.cc:302] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaadf35fd34f4c228e11f26623f17c84; no voters:
I20260809 02:01:57.015674 5795 leader_election.cc:288] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:57.015763 5805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:57.016024 5805 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [term 1 LEADER]: Becoming Leader. State: Replica: eaadf35fd34f4c228e11f26623f17c84, State: Running, Role: LEADER
I20260809 02:01:57.016395 5805 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } }
I20260809 02:01:57.016999 5795 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:57.017446 5798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:57.015334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:37969 (local address 127.0.0.1:42733)
0809 02:01:57.015464 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:57.015469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:57.015630 (+ 161us) server_negotiation.cc:407] Connection header received
0809 02:01:57.015851 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:57.015854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:57.015893 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:57.015982 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:57.016844 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:57.016847 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:57.016849 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:57.016861 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:57.016890 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:57.016903 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:57.016989 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:57.017288 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 02:01:57.017331 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:01:57.018396 5806 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaadf35fd34f4c228e11f26623f17c84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } } }
I20260809 02:01:57.018466 5807 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaadf35fd34f4c228e11f26623f17c84. Latest consensus state: current_term: 1 leader_uuid: "eaadf35fd34f4c228e11f26623f17c84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaadf35fd34f4c228e11f26623f17c84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42733 } } }
I20260809 02:01:57.018558 5806 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:57.018594 5807 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84 [sys.catalog]: This master's current role is: LEADER
W20260809 02:01:57.021687 5820 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:01:57.021756 5820 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:01:57.021843 5815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:57.022518 5815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:57.027796 5815 catalog_manager.cc:1347] Generated new cluster ID: a0a92db256e8495b991eb0f45828bb67
I20260809 02:01:57.027889 5815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:57.037797 5815 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:57.038101 5815 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:57.042600 5815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaadf35fd34f4c228e11f26623f17c84: Generated new TSK 0
I20260809 02:01:57.043334 5815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:57.047125 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5720
2026-08-09T02:01:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:57 dist-test-slave-2w3w krb5kdc[5827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:57 dist-test-slave-2w3w krb5kdc[5827](info): set up 2 sockets
Aug 09 02:01:57 dist-test-slave-2w3w krb5kdc[5827](info): commencing operation
krb5kdc: starting...
W20260809 02:01:58.120014 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:01:58.245414 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35263
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:35263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:58.358912 5840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:58.359169 5840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:58.359210 5840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:58.363265 5840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:58.363317 5840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:58.363343 5840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:58.363359 5840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:58.363375 5840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:58.368415 5840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:35263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:35263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:58.369246 5840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:58.370110 5840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:58.378309 5847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:58.378279 5849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:58.378295 5846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:58.378528 5840 server_base.cc:1034] running on GCE node
I20260809 02:01:58.379194 5840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:58.380223 5840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:58.381395 5840 hybrid_clock.cc:648] HybridClock initialized: now 1786240918381376 us; error 30 us; skew 500 ppm
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240918, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:58.384136 5840 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:58.385017 5840 webserver.cc:460] Webserver started at http://127.14.175.254:37267/ using document root <none> and password file <none>
I20260809 02:01:58.385548 5840 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:58.385609 5840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:58.385842 5840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:58.387840 5840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "9ccde05ff4c640d682a8c8717c0fb8bf"
format_stamp: "Formatted at 2026-08-09 02:01:58 on dist-test-slave-2w3w"
server_key: "11b0429864907e65065a3b32a212838e"
server_key_iv: "407e1986c4072bb6e0016b611987f7dd"
server_key_version: "encryptionkey@0"
I20260809 02:01:58.388413 5840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "9ccde05ff4c640d682a8c8717c0fb8bf"
format_stamp: "Formatted at 2026-08-09 02:01:58 on dist-test-slave-2w3w"
server_key: "11b0429864907e65065a3b32a212838e"
server_key_iv: "407e1986c4072bb6e0016b611987f7dd"
server_key_version: "encryptionkey@0"
I20260809 02:01:58.391953 5840 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:01:58.394194 5856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:58.395485 5840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:01:58.395628 5840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "9ccde05ff4c640d682a8c8717c0fb8bf"
format_stamp: "Formatted at 2026-08-09 02:01:58 on dist-test-slave-2w3w"
server_key: "11b0429864907e65065a3b32a212838e"
server_key_iv: "407e1986c4072bb6e0016b611987f7dd"
server_key_version: "encryptionkey@0"
I20260809 02:01:58.395737 5840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:58.410425 5840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:58.413400 5840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:58.413599 5840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:58.420917 5840 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:35263
I20260809 02:01:58.420940 5913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:35263 every 8 connection(s)
I20260809 02:01:58.421878 5840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:58.424480 5914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:58.429595 5914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf: Bootstrap starting.
I20260809 02:01:58.431895 5914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:58.431937 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5840
I20260809 02:01:58.432091 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:58.432363 15039 external_mini_cluster.cc:1428] Setting key 3b9a68b24eba544f2c7011188838a9a4
I20260809 02:01:58.432753 5914 log.cc:824] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:58.434684 5914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf: No bootstrap required, opened a new log
I20260809 02:01:58.438804 5914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } }
I20260809 02:01:58.439103 5914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:58.439188 5914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ccde05ff4c640d682a8c8717c0fb8bf, State: Initialized, Role: FOLLOWER
I20260809 02:01:58.440024 5914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } }
I20260809 02:01:58.440222 5914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:58.440297 5914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:58.440414 5914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 0 FOLLOWER]: Advancing to term 1
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:01:58.441388 5914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } }
I20260809 02:01:58.441738 5914 leader_election.cc:302] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ccde05ff4c640d682a8c8717c0fb8bf; no voters:
I20260809 02:01:58.442062 5914 leader_election.cc:288] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:58.442140 5921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:58.442369 5921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [term 1 LEADER]: Becoming Leader. State: Replica: 9ccde05ff4c640d682a8c8717c0fb8bf, State: Running, Role: LEADER
I20260809 02:01:58.442694 5921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } }
I20260809 02:01:58.443372 5914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:58.444981 5923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } } }
I20260809 02:01:58.444962 5922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ccde05ff4c640d682a8c8717c0fb8bf. Latest consensus state: current_term: 1 leader_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccde05ff4c640d682a8c8717c0fb8bf" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 35263 } } }
I20260809 02:01:58.445118 5923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:58.445174 5922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:58.445566 5934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:58.447862 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:58.433420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51169 (local address 127.14.175.254:35263)
0809 02:01:58.433844 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:58.433867 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:58.433900 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:01:58.434520 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:58.434536 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:58.434891 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:58.435226 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:58.436137 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:58.437064 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:58.438341 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:58.438783 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:58.438901 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:58.441980 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:58.441985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:58.441996 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:58.442022 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:58.444134 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:58.445097 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:58.445104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:58.445110 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:58.445276 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:58.445685 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:58.445688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:58.445690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:58.446176 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:58.446390 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:58.446879 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 02:01:58.447138 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":150,"threads_started":1}
I20260809 02:01:58.449922 5934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:58.450740 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:58.455425 5934 catalog_manager.cc:1347] Generated new cluster ID: 0b5bbe29319347148d053882f8e156dc
I20260809 02:01:58.455482 5934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:58.462109 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:58.452857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49509 (local address 127.14.175.254:35263)
0809 02:01:58.452951 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:58.452955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:58.453202 (+ 247us) server_negotiation.cc:407] Connection header received
0809 02:01:58.453303 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:58.453307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:58.453350 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:58.453431 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:58.454156 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:58.455426 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:58.456657 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:58.457006 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:58.457098 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:58.458656 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:58.458660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:58.458662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:01:58.458685 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:58.460300 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:58.460872 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:58.460875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:58.460877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:58.460952 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:01:58.461298 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:01:58.461300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:01:58.461302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:01:58.461481 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:58.461601 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:58.461884 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 02:01:58.461970 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:01:58.467343 5934 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:58.468156 5934 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:58.473160 5934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ccde05ff4c640d682a8c8717c0fb8bf: Generated new TSK 0
I20260809 02:01:58.473811 5934 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:58.480857 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5840
W20260809 02:01:58.488866 5824 connection.cc:535] client connection to 127.14.175.254:35263 recv error: Network error: failed to read from TLS socket (remote: 127.14.175.254:35263): Connection reset by peer (error 104)
2026-08-09T02:01:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5947](info): set up 2 sockets
Aug 09 02:01:58 dist-test-slave-2w3w krb5kdc[5947](info): commencing operation
krb5kdc: starting...
W20260809 02:01:59.568158 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:01:59 dist-test-slave-2w3w krb5kdc[5947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:01:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:01:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:01:59.691907 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:44261
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:44261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:01:59.799958 5960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:01:59.800246 5960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:01:59.800315 5960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:01:59.804286 5960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:01:59.804371 5960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:01:59.804409 5960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:01:59.804446 5960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:01:59.804483 5960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:01:59.809562 5960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:44261
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:44261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:01:59.810537 5960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:01:59.811533 5960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:01:59.819767 5965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:59.819866 5968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:01:59.819871 5966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:01:59.820156 5960 server_base.cc:1034] running on GCE node
I20260809 02:01:59.820655 5960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:01:59.821704 5960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:01:59.822891 5960 hybrid_clock.cc:648] HybridClock initialized: now 1786240919822872 us; error 31 us; skew 500 ppm
Aug 09 02:01:59 dist-test-slave-2w3w krb5kdc[5947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240919, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:01:59.825704 5960 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:01:59.826556 5960 webserver.cc:460] Webserver started at http://127.14.175.254:33277/ using document root <none> and password file <none>
I20260809 02:01:59.827178 5960 fs_manager.cc:359] Metadata directory not provided
I20260809 02:01:59.827268 5960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:01:59.827498 5960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:01:59.829517 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "8cf0f2f255d8491a90f6d07bb28f24d0"
format_stamp: "Formatted at 2026-08-09 02:01:59 on dist-test-slave-2w3w"
server_key: "6576ebcc25592762a546b2fc273820a0"
server_key_iv: "dda6f6a30056b42734be2d0c40462bd3"
server_key_version: "encryptionkey@0"
I20260809 02:01:59.830090 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "8cf0f2f255d8491a90f6d07bb28f24d0"
format_stamp: "Formatted at 2026-08-09 02:01:59 on dist-test-slave-2w3w"
server_key: "6576ebcc25592762a546b2fc273820a0"
server_key_iv: "dda6f6a30056b42734be2d0c40462bd3"
server_key_version: "encryptionkey@0"
I20260809 02:01:59.833791 5960 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 02:01:59.836149 5975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:01:59.837309 5960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:01:59.837457 5960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "8cf0f2f255d8491a90f6d07bb28f24d0"
format_stamp: "Formatted at 2026-08-09 02:01:59 on dist-test-slave-2w3w"
server_key: "6576ebcc25592762a546b2fc273820a0"
server_key_iv: "dda6f6a30056b42734be2d0c40462bd3"
server_key_version: "encryptionkey@0"
I20260809 02:01:59.837564 5960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:01:59.850585 5960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:01:59.853288 5960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:01:59.853477 5960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:01:59.860484 5960 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:44261
I20260809 02:01:59.860558 6030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:44261 every 8 connection(s)
I20260809 02:01:59.861384 5960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:01:59.864049 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:01:59.868223 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 5960
I20260809 02:01:59.868392 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:01:59.868660 15039 external_mini_cluster.cc:1428] Setting key 4f5cc1e60f730d488f6c98d60d120a8a
I20260809 02:01:59.869500 6031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: Bootstrap starting.
I20260809 02:01:59.872133 6031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: Neither blocks nor log segments found. Creating new log.
I20260809 02:01:59.872994 6031 log.cc:824] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:01:59.874917 6031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: No bootstrap required, opened a new log
I20260809 02:01:59.878566 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:59.869906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52459 (local address 127.14.175.254:44261)
0809 02:01:59.870303 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:59.870321 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:59.870361 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:01:59.871259 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:59.871282 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:59.871683 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:59.872021 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:59.872459 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:59.873834 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:59.874750 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:59.875454 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:59.875634 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:59.876483 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:59.876489 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:59.876504 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:59.877009 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:59.877081 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:59.877110 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:59.877246 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:59.877409 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 02:01:59.877554 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":110,"threads_started":1}
I20260809 02:01:59.879361 6031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } }
I20260809 02:01:59.879614 6031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:01:59.879685 6031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cf0f2f255d8491a90f6d07bb28f24d0, State: Initialized, Role: FOLLOWER
I20260809 02:01:59.880136 6031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } }
I20260809 02:01:59.880288 6031 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:01:59.880391 6031 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:01:59.880501 6031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:01:59.881536 6031 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } }
I20260809 02:01:59.881651 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:01:59.881892 6031 leader_election.cc:302] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cf0f2f255d8491a90f6d07bb28f24d0; no voters:
I20260809 02:01:59.882237 6031 leader_election.cc:288] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:01:59.882392 6036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:01:59.882629 6036 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [term 1 LEADER]: Becoming Leader. State: Replica: 8cf0f2f255d8491a90f6d07bb28f24d0, State: Running, Role: LEADER
I20260809 02:01:59.883018 6036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } }
I20260809 02:01:59.883569 6031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:01:59.884812 6038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cf0f2f255d8491a90f6d07bb28f24d0. Latest consensus state: current_term: 1 leader_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } } }
I20260809 02:01:59.884936 6038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:01:59.885270 6037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf0f2f255d8491a90f6d07bb28f24d0" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44261 } } }
I20260809 02:01:59.885365 6037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0 [sys.catalog]: This master's current role is: LEADER
W20260809 02:01:59.888787 6059 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:01:59.888912 6059 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:01:59.888984 6051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:01:59.889024 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:01:59.883933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50525 (local address 127.14.175.254:44261)
0809 02:01:59.884047 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:01:59.884051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:01:59.884294 (+ 243us) server_negotiation.cc:407] Connection header received
0809 02:01:59.884499 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:01:59.884519 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:01:59.884574 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:01:59.884633 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:01:59.885077 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:59.885898 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:59.887070 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:01:59.887433 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:01:59.887567 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:01:59.888425 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:01:59.888429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:01:59.888431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:01:59.888444 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:01:59.888477 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:01:59.888487 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:01:59.888585 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:01:59.888721 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 02:01:59.888756 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:01:59.889818 6051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:01:59.895241 6051 catalog_manager.cc:1347] Generated new cluster ID: 402f18a8e99a4cd2b25cb6895e1f3fc0
I20260809 02:01:59.895314 6051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:01:59.913653 6051 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:01:59.914575 6051 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:01:59.923641 6051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cf0f2f255d8491a90f6d07bb28f24d0: Generated new TSK 0
I20260809 02:01:59.924414 6051 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:01:59.932957 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 5960
W20260809 02:01:59.940830 5945 connection.cc:535] client connection to 127.14.175.254:44261 recv error: Network error: failed to read from TLS socket (remote: 127.14.175.254:44261): Connection reset by peer (error 104)
2026-08-09T02:01:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:01:59 dist-test-slave-2w3w krb5kdc[6067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:01:59 dist-test-slave-2w3w krb5kdc[6067](info): set up 2 sockets
Aug 09 02:01:59 dist-test-slave-2w3w krb5kdc[6067](info): commencing operation
krb5kdc: starting...
W20260809 02:02:01.008371 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:01 dist-test-slave-2w3w krb5kdc[6067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:01.134438 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41399
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:36855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:41399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:01.240388 6081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:01.240629 6081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:01.240712 6081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:01.244652 6081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:01.244704 6081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:01.244750 6081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:01.244788 6081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:01.244817 6081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:01.249864 6081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:36855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:41399
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:41399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:01.250809 6081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:01.251780 6081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:01.260128 6086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:01.260167 6081 server_base.cc:1034] running on GCE node
W20260809 02:02:01.260140 6087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:01.260092 6089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:01.260977 6081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:01.261997 6081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:01.263175 6081 hybrid_clock.cc:648] HybridClock initialized: now 1786240921263153 us; error 34 us; skew 500 ppm
Aug 09 02:02:01 dist-test-slave-2w3w krb5kdc[6067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240921, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:01.266010 6081 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:01.266810 6081 webserver.cc:460] Webserver started at http://127.14.175.254:39453/ using document root <none> and password file <none>
I20260809 02:02:01.267387 6081 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:01.267459 6081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:01.267620 6081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:01.269728 6081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "3c6343171a124688abf012679cf6ec41"
format_stamp: "Formatted at 2026-08-09 02:02:01 on dist-test-slave-2w3w"
server_key: "c5f53baca202f28c1c6bcc5d1730ee89"
server_key_iv: "10bf280aa6a820b52bb7d5d75ffe02e6"
server_key_version: "encryptionkey@0"
I20260809 02:02:01.270237 6081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "3c6343171a124688abf012679cf6ec41"
format_stamp: "Formatted at 2026-08-09 02:02:01 on dist-test-slave-2w3w"
server_key: "c5f53baca202f28c1c6bcc5d1730ee89"
server_key_iv: "10bf280aa6a820b52bb7d5d75ffe02e6"
server_key_version: "encryptionkey@0"
I20260809 02:02:01.273840 6081 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:02:01.276192 6096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:01.277447 6081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:02:01.277601 6081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "3c6343171a124688abf012679cf6ec41"
format_stamp: "Formatted at 2026-08-09 02:02:01 on dist-test-slave-2w3w"
server_key: "c5f53baca202f28c1c6bcc5d1730ee89"
server_key_iv: "10bf280aa6a820b52bb7d5d75ffe02e6"
server_key_version: "encryptionkey@0"
I20260809 02:02:01.277707 6081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:01.282162 6081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:01.285346 6081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:01.285547 6081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:01.292618 6081 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:41399
I20260809 02:02:01.292672 6149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:41399 every 8 connection(s)
I20260809 02:02:01.293510 6081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:01.296134 6150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:01.299865 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6081
I20260809 02:02:01.300015 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:01.300309 15039 external_mini_cluster.cc:1428] Setting key efdf11868828d8a63641e6773d1ac4a3
I20260809 02:02:01.301848 6150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: Bootstrap starting.
I20260809 02:02:01.304530 6150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:01.305414 6150 log.cc:824] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:01.305895 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:01.301696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46315 (local address 127.14.175.254:41399)
0809 02:02:01.302145 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:01.302163 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:01.302205 (+ 42us) server_negotiation.cc:407] Connection header received
0809 02:02:01.303091 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:01.303114 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:01.303469 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:01.303810 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:01.304530 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:01.304536 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:01.304551 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:01.304564 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:01.304628 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:01.304658 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:01.304783 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:01.304867 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 02:02:01.305009 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":115,"threads_started":1}
I20260809 02:02:01.307488 6150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: No bootstrap required, opened a new log
I20260809 02:02:01.308733 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:02:01.311616 6150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } }
I20260809 02:02:01.311904 6150 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:02:01.311975 6150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6343171a124688abf012679cf6ec41, State: Initialized, Role: FOLLOWER
I20260809 02:02:01.312377 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:01.310754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37285 (local address 127.14.175.254:41399)
0809 02:02:01.310888 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:01.310893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:01.311058 (+ 165us) server_negotiation.cc:407] Connection header received
0809 02:02:01.311186 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:01.311188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:01.311213 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:01.311277 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:01.311969 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:01.311976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:01.311978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:01.311992 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:01.312022 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:01.312034 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:01.312113 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:01.312209 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 02:02:01.312248 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:02:01.312458 6150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } }
I20260809 02:02:01.312635 6150 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:02:01.312711 6150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:02:01.312816 6150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:01.313833 6150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } }
I20260809 02:02:01.314116 6150 leader_election.cc:302] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c6343171a124688abf012679cf6ec41; no voters:
I20260809 02:02:01.314345 6150 leader_election.cc:288] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:02:01.314473 6162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:01.314729 6162 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [term 1 LEADER]: Becoming Leader. State: Replica: 3c6343171a124688abf012679cf6ec41, State: Running, Role: LEADER
I20260809 02:02:01.315096 6162 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } }
I20260809 02:02:01.315586 6150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:01.316721 6164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c6343171a124688abf012679cf6ec41. Latest consensus state: current_term: 1 leader_uuid: "3c6343171a124688abf012679cf6ec41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } } }
I20260809 02:02:01.317098 6164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:01.316960 6163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c6343171a124688abf012679cf6ec41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c6343171a124688abf012679cf6ec41" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 41399 } } }
I20260809 02:02:01.317462 6163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41 [sys.catalog]: This master's current role is: LEADER
W20260809 02:02:01.320607 6177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:01.320676 6177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:01.320765 6174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:01.321465 6174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:01.326687 6174 catalog_manager.cc:1347] Generated new cluster ID: 3cc6eded501241b089eff751d618ffa2
I20260809 02:02:01.326754 6174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:01.341790 6174 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:01.342142 6174 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:01.351159 6174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c6343171a124688abf012679cf6ec41: Generated new TSK 0
I20260809 02:02:01.351845 6174 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:02:01.357026 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6081
2026-08-09T02:02:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:02:01 dist-test-slave-2w3w krb5kdc[6183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:02:01 dist-test-slave-2w3w krb5kdc[6183](info): set up 2 sockets
Aug 09 02:02:01 dist-test-slave-2w3w krb5kdc[6183](info): commencing operation
krb5kdc: starting...
W20260809 02:02:02.515462 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:02.640383 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:44495
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:32829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:44495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:02.749208 6197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:02.749521 6197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:02.749617 6197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:02.753775 6197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:02.753875 6197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:02.753916 6197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:02.753952 6197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:02.753988 6197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:02.759202 6197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:32829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:44495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:44495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:02.760238 6197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:02.761243 6197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:02.769805 6203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:02.769802 6202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:02.769878 6205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:02.770066 6197 server_base.cc:1034] running on GCE node
I20260809 02:02:02.770627 6197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:02.771759 6197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:02.772933 6197 hybrid_clock.cc:648] HybridClock initialized: now 1786240922772913 us; error 34 us; skew 500 ppm
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240922, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:02.780921 6197 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:02.781786 6197 webserver.cc:460] Webserver started at http://127.14.175.254:45089/ using document root <none> and password file <none>
I20260809 02:02:02.782294 6197 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:02.782351 6197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:02.782521 6197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:02.784617 6197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "2597d41058494656afb5f471a8b1cbe1"
format_stamp: "Formatted at 2026-08-09 02:02:02 on dist-test-slave-2w3w"
server_key: "26a06e4cb2e83fa8d2d6a9d6fca0ecac"
server_key_iv: "04eb9b2a21665dcccbfa352f52dba4f1"
server_key_version: "encryptionkey@0"
I20260809 02:02:02.785121 6197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "2597d41058494656afb5f471a8b1cbe1"
format_stamp: "Formatted at 2026-08-09 02:02:02 on dist-test-slave-2w3w"
server_key: "26a06e4cb2e83fa8d2d6a9d6fca0ecac"
server_key_iv: "04eb9b2a21665dcccbfa352f52dba4f1"
server_key_version: "encryptionkey@0"
I20260809 02:02:02.788779 6197 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:02:02.791121 6212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:02.792338 6197 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:02:02.792469 6197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "2597d41058494656afb5f471a8b1cbe1"
format_stamp: "Formatted at 2026-08-09 02:02:02 on dist-test-slave-2w3w"
server_key: "26a06e4cb2e83fa8d2d6a9d6fca0ecac"
server_key_iv: "04eb9b2a21665dcccbfa352f52dba4f1"
server_key_version: "encryptionkey@0"
I20260809 02:02:02.792591 6197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:02.811093 6197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:02.813846 6197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:02.814064 6197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:02.821213 6197 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:44495
I20260809 02:02:02.821238 6269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:44495 every 8 connection(s)
I20260809 02:02:02.822150 6197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:02.824817 6270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:02.827225 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6197
I20260809 02:02:02.827406 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:02.827719 15039 external_mini_cluster.cc:1428] Setting key 0c8a446698c21582f8fc83fcd68ac686
I20260809 02:02:02.831068 6270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: Bootstrap starting.
I20260809 02:02:02.833199 6270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:02.833891 6270 log.cc:824] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:02.836267 6270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: No bootstrap required, opened a new log
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:02:02.839587 6270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } }
I20260809 02:02:02.839833 6270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:02:02.839916 6270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2597d41058494656afb5f471a8b1cbe1, State: Initialized, Role: FOLLOWER
I20260809 02:02:02.840425 6270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } }
I20260809 02:02:02.840602 6270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:02:02.840691 6270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:02:02.840785 6270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:02.841861 6270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } }
I20260809 02:02:02.842198 6270 leader_election.cc:302] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2597d41058494656afb5f471a8b1cbe1; no voters:
I20260809 02:02:02.842540 6270 leader_election.cc:288] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:02:02.842651 6275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:02.842886 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:02.829185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44377 (local address 127.14.175.254:44495)
0809 02:02:02.829619 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:02.829634 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:02.829667 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:02:02.830327 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:02.830345 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:02.830667 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:02.831022 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:02.831866 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:02.832852 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:02.833776 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:02.834336 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:02.834512 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:02.837349 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:02.837354 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:02.837366 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:02.837392 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:02.839643 (+ 2251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:02.840140 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:02.840146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:02.840150 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:02.840285 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:02.840584 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:02.840587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:02.840589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:02.841137 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:02.841353 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:02.841540 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:02:02.841850 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":133,"threads_started":1}
I20260809 02:02:02.842901 6275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 2597d41058494656afb5f471a8b1cbe1, State: Running, Role: LEADER
I20260809 02:02:02.843672 6275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } }
I20260809 02:02:02.843770 6270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:02.845427 6276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2597d41058494656afb5f471a8b1cbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } } }
I20260809 02:02:02.845554 6276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:02.845746 6277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2597d41058494656afb5f471a8b1cbe1. Latest consensus state: current_term: 1 leader_uuid: "2597d41058494656afb5f471a8b1cbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2597d41058494656afb5f471a8b1cbe1" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 44495 } } }
I20260809 02:02:02.845840 6277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:02.846501 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 02:02:02.849094 6290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:02.849184 6290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:02.849268 6288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:02.849937 6288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:02.855705 6288 catalog_manager.cc:1347] Generated new cluster ID: 3a0c6db930c843f7b2f097daf0a1db2f
I20260809 02:02:02.855764 6288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:02.857537 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:02.848870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47139 (local address 127.14.175.254:44495)
0809 02:02:02.848969 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:02.848973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:02.849187 (+ 214us) server_negotiation.cc:407] Connection header received
0809 02:02:02.849368 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:02.849370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:02.849415 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:02.849463 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:02.850367 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:02.851177 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:02.852110 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:02.852346 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:02.852461 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:02.854077 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:02.854083 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:02.854090 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:02.854112 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:02.855900 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:02.856348 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:02.856353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:02.856354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:02.856438 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:02.856717 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:02.856720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:02.856722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:02.856903 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:02.857034 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:02.857263 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 02:02:02.857383 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:02:02.880685 6288 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:02.881600 6288 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:02.897864 6288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2597d41058494656afb5f471a8b1cbe1: Generated new TSK 0
I20260809 02:02:02.898607 6288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:02:02.907101 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6197
2026-08-09T02:02:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1551 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6303](info): set up 2 sockets
Aug 09 02:02:02 dist-test-slave-2w3w krb5kdc[6303](info): commencing operation
krb5kdc: starting...
W20260809 02:02:03.993505 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:04 dist-test-slave-2w3w krb5kdc[6303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:04.121456 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33827
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:33827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:04.230772 6317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:04.231025 6317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:04.231066 6317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:04.237355 6317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:04.237432 6317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:04.237469 6317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:04.237495 6317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:04.237529 6317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:04.243882 6317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:33827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:33827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:04.244758 6317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:04.245654 6317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:04.253661 6323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:04.253644 6322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:04.254034 6317 server_base.cc:1034] running on GCE node
W20260809 02:02:04.253645 6325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:04.254592 6317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:04.255787 6317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:04.256947 6317 hybrid_clock.cc:648] HybridClock initialized: now 1786240924256919 us; error 40 us; skew 500 ppm
Aug 09 02:02:04 dist-test-slave-2w3w krb5kdc[6303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240924, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:04.259708 6317 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:04.260564 6317 webserver.cc:460] Webserver started at http://127.14.175.254:35989/ using document root <none> and password file <none>
I20260809 02:02:04.261088 6317 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:04.261176 6317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:04.261410 6317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:04.263406 6317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "1f78ed1bac6b40ef9112332a20771d20"
format_stamp: "Formatted at 2026-08-09 02:02:04 on dist-test-slave-2w3w"
server_key: "8b3090ea7edd608b5ba75ce12800f364"
server_key_iv: "1322c0aab38ea20891859931dae44dc4"
server_key_version: "encryptionkey@0"
I20260809 02:02:04.263955 6317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "1f78ed1bac6b40ef9112332a20771d20"
format_stamp: "Formatted at 2026-08-09 02:02:04 on dist-test-slave-2w3w"
server_key: "8b3090ea7edd608b5ba75ce12800f364"
server_key_iv: "1322c0aab38ea20891859931dae44dc4"
server_key_version: "encryptionkey@0"
I20260809 02:02:04.267428 6317 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:02:04.269642 6333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:04.270852 6317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:02:04.271030 6317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "1f78ed1bac6b40ef9112332a20771d20"
format_stamp: "Formatted at 2026-08-09 02:02:04 on dist-test-slave-2w3w"
server_key: "8b3090ea7edd608b5ba75ce12800f364"
server_key_iv: "1322c0aab38ea20891859931dae44dc4"
server_key_version: "encryptionkey@0"
I20260809 02:02:04.271154 6317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:04.285797 6317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:04.288934 6317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:04.289140 6317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:04.296218 6317 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:33827
I20260809 02:02:04.296252 6390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:33827 every 8 connection(s)
I20260809 02:02:04.297123 6317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:04.297605 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6317
I20260809 02:02:04.297777 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:04.298095 15039 external_mini_cluster.cc:1428] Setting key a11abac054f74aa1718d76cb022ad94e
I20260809 02:02:04.300217 6392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:04.306764 6392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20: Bootstrap starting.
I20260809 02:02:04.307854 6395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:04.299471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35825 (local address 127.14.175.254:33827)
0809 02:02:04.299899 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:04.299920 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:04.299966 (+ 46us) server_negotiation.cc:407] Connection header received
0809 02:02:04.300796 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:04.300819 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:04.301222 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:04.301578 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:04.301958 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:04.303472 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:04.304341 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:04.305010 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:04.305163 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:04.305965 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:04.305973 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:04.305986 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:04.306451 (+ 465us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:04.306515 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:04.306541 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:04.306642 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:04.306777 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:02:04.307001 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":131,"threads_started":1}
I20260809 02:02:04.309252 6392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:04.310070 6392 log.cc:824] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:04.310648 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:02:04.312368 6392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20: No bootstrap required, opened a new log
I20260809 02:02:04.316984 6395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:04.312880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49623 (local address 127.14.175.254:33827)
0809 02:02:04.313002 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:04.313005 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:04.313163 (+ 158us) server_negotiation.cc:407] Connection header received
0809 02:02:04.313248 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:04.313250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:04.313284 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:04.313357 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:04.313636 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:04.314140 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:04.315380 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:04.315598 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:04.315687 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:04.316493 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:04.316499 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:04.316506 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:04.316517 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:04.316540 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:04.316550 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:04.316610 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:04.316747 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 02:02:04.316816 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:02:04.316991 6392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } }
I20260809 02:02:04.317322 6392 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:02:04.317384 6392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f78ed1bac6b40ef9112332a20771d20, State: Initialized, Role: FOLLOWER
I20260809 02:02:04.317766 6392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } }
I20260809 02:02:04.317955 6392 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:02:04.318030 6392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:02:04.318136 6392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:04.319079 6392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } }
I20260809 02:02:04.319435 6392 leader_election.cc:302] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f78ed1bac6b40ef9112332a20771d20; no voters:
I20260809 02:02:04.319795 6392 leader_election.cc:288] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:02:04.319916 6402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:04.320180 6402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [term 1 LEADER]: Becoming Leader. State: Replica: 1f78ed1bac6b40ef9112332a20771d20, State: Running, Role: LEADER
I20260809 02:02:04.320551 6402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } }
I20260809 02:02:04.321046 6392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:04.322294 6403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f78ed1bac6b40ef9112332a20771d20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } } }
I20260809 02:02:04.322299 6404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f78ed1bac6b40ef9112332a20771d20. Latest consensus state: current_term: 1 leader_uuid: "1f78ed1bac6b40ef9112332a20771d20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f78ed1bac6b40ef9112332a20771d20" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 33827 } } }
I20260809 02:02:04.322448 6403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:04.322453 6404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:04.322815 6412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:04.325529 6412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:04.331216 6412 catalog_manager.cc:1347] Generated new cluster ID: 926038a2a0f54852a120b8af322df214
I20260809 02:02:04.331331 6412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:04.345647 6412 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:04.346586 6412 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:04.352092 6412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f78ed1bac6b40ef9112332a20771d20: Generated new TSK 0
I20260809 02:02:04.352713 6412 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:02:04.357331 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6317
2026-08-09T02:02:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:02:04 dist-test-slave-2w3w krb5kdc[6424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:02:04 dist-test-slave-2w3w krb5kdc[6424](info): set up 2 sockets
Aug 09 02:02:04 dist-test-slave-2w3w krb5kdc[6424](info): commencing operation
krb5kdc: starting...
W20260809 02:02:05.445623 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:05 dist-test-slave-2w3w krb5kdc[6424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:05.573945 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34445
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:05.685645 6437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:05.685890 6437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:05.685930 6437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:05.689929 6437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:05.689987 6437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:05.690006 6437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:05.690022 6437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:05.690075 6437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:05.695199 6437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:05.696142 6437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:05.697106 6437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:05.705461 6442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:05.705461 6445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:05.705515 6443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:05.705514 6437 server_base.cc:1034] running on GCE node
I20260809 02:02:05.706295 6437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:05.707366 6437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:05.708525 6437 hybrid_clock.cc:648] HybridClock initialized: now 1786240925708500 us; error 39 us; skew 500 ppm
Aug 09 02:02:05 dist-test-slave-2w3w krb5kdc[6424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240925, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:05.711233 6437 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:05.712042 6437 webserver.cc:460] Webserver started at http://127.14.175.254:46629/ using document root <none> and password file <none>
I20260809 02:02:05.712570 6437 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:05.712658 6437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:05.712879 6437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:05.714839 6437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "5f3f9db94e4048aeb071be7c9a4db0da"
format_stamp: "Formatted at 2026-08-09 02:02:05 on dist-test-slave-2w3w"
server_key: "6d2ad8b015f3525e6615c8f381c087f5"
server_key_iv: "eb9560ce2ca3c44f247d387c537b2d1a"
server_key_version: "encryptionkey@0"
I20260809 02:02:05.715473 6437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "5f3f9db94e4048aeb071be7c9a4db0da"
format_stamp: "Formatted at 2026-08-09 02:02:05 on dist-test-slave-2w3w"
server_key: "6d2ad8b015f3525e6615c8f381c087f5"
server_key_iv: "eb9560ce2ca3c44f247d387c537b2d1a"
server_key_version: "encryptionkey@0"
I20260809 02:02:05.719116 6437 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:02:05.721418 6453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:05.722550 6437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:02:05.722705 6437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "5f3f9db94e4048aeb071be7c9a4db0da"
format_stamp: "Formatted at 2026-08-09 02:02:05 on dist-test-slave-2w3w"
server_key: "6d2ad8b015f3525e6615c8f381c087f5"
server_key_iv: "eb9560ce2ca3c44f247d387c537b2d1a"
server_key_version: "encryptionkey@0"
I20260809 02:02:05.722815 6437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:05.727238 6437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:05.729962 6437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:05.730149 6437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:05.737351 6437 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:34445
I20260809 02:02:05.737357 6511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:34445 every 8 connection(s)
I20260809 02:02:05.738181 6437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:05.740042 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6437
I20260809 02:02:05.740198 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:05.740486 15039 external_mini_cluster.cc:1428] Setting key 4700f29a3fd978744c3fe2d9abeaaddf
I20260809 02:02:05.740893 6512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:05.745884 6515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:05.741805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52687 (local address 127.14.175.254:34445)
0809 02:02:05.742253 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:05.742272 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:05.742312 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:02:05.743136 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:05.743158 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:05.743487 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:05.743906 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:05.744573 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:05.744579 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:05.744593 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:05.744604 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:05.744670 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:05.744696 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:05.744834 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:05.744908 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:02:05.745050 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":132,"threads_started":1}
I20260809 02:02:05.747995 6512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da: Bootstrap starting.
I20260809 02:02:05.748638 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:02:05.750290 6512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:05.751346 6512 log.cc:824] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:05.752158 6515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:05.750528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40173 (local address 127.14.175.254:34445)
0809 02:02:05.750641 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:05.750645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:05.750830 (+ 185us) server_negotiation.cc:407] Connection header received
0809 02:02:05.750910 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:05.750913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:05.750943 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:05.751061 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:05.751731 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:05.751735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:05.751737 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:02:05.751749 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:05.751774 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:02:05.751787 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:05.751897 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:05.751993 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 02:02:05.752031 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:02:05.753279 6512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da: No bootstrap required, opened a new log
I20260809 02:02:05.756676 6512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } }
I20260809 02:02:05.756906 6512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:02:05.756981 6512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3f9db94e4048aeb071be7c9a4db0da, State: Initialized, Role: FOLLOWER
I20260809 02:02:05.757364 6512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } }
I20260809 02:02:05.757512 6512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:02:05.757601 6512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:02:05.757697 6512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:05.758524 6512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } }
I20260809 02:02:05.758854 6512 leader_election.cc:302] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f3f9db94e4048aeb071be7c9a4db0da; no voters:
I20260809 02:02:05.759184 6512 leader_election.cc:288] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:02:05.759300 6522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:05.759555 6522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [term 1 LEADER]: Becoming Leader. State: Replica: 5f3f9db94e4048aeb071be7c9a4db0da, State: Running, Role: LEADER
I20260809 02:02:05.759889 6522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } }
I20260809 02:02:05.760385 6512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:05.761420 6524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f3f9db94e4048aeb071be7c9a4db0da. Latest consensus state: current_term: 1 leader_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } } }
I20260809 02:02:05.761552 6524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:05.761747 6523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f9db94e4048aeb071be7c9a4db0da" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 34445 } } }
I20260809 02:02:05.761893 6523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:05.761976 6534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:05.765051 6534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:05.769680 6534 catalog_manager.cc:1347] Generated new cluster ID: 30231ba582b746adba4d6775de9bf443
I20260809 02:02:05.769737 6534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:05.778358 6534 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:05.778604 6534 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:05.789079 6534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f3f9db94e4048aeb071be7c9a4db0da: Generated new TSK 0
I20260809 02:02:05.789850 6534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:02:05.796499 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6437
2026-08-09T02:02:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1438 ms)
[----------] 18 tests from AuthTokenIssuingTest (26103 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:02:05 dist-test-slave-2w3w krb5kdc[6547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:02:05 dist-test-slave-2w3w krb5kdc[6547](info): set up 2 sockets
Aug 09 02:02:05 dist-test-slave-2w3w krb5kdc[6547](info): commencing operation
krb5kdc: starting...
W20260809 02:02:06.876737 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:06 dist-test-slave-2w3w krb5kdc[6547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:07.002063 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40733
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:46547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:07.116547 6560 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:02:07.116851 6560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:07.116919 6560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:07.116998 6560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:07.120931 6560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:07.121009 6560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:07.121052 6560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:07.121088 6560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:07.121124 6560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:07.126187 6560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:46547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:40733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:07.127174 6560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:07.128129 6560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:07.136013 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:07.136049 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:07.136099 6568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:07.136202 6560 server_base.cc:1034] running on GCE node
I20260809 02:02:07.136732 6560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:07.137773 6560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:07.138999 6560 hybrid_clock.cc:648] HybridClock initialized: now 1786240927138942 us; error 33 us; skew 500 ppm
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:07.141593 6560 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:07.142432 6560 webserver.cc:460] Webserver started at http://127.14.175.254:35991/ using document root <none> and password file <none>
I20260809 02:02:07.142946 6560 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:07.143090 6560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:07.143316 6560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:07.145227 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "cc9547e01545431d88f16ee407ee32f7"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "bd42661cf8824b1649f6d124f2877e38"
server_key_iv: "5ab2294015c52cf2f8628fdae78aca2d"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.145777 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "cc9547e01545431d88f16ee407ee32f7"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "bd42661cf8824b1649f6d124f2877e38"
server_key_iv: "5ab2294015c52cf2f8628fdae78aca2d"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.149226 6560 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:02:07.151461 6575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:07.152547 6560 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:02:07.152681 6560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "cc9547e01545431d88f16ee407ee32f7"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "bd42661cf8824b1649f6d124f2877e38"
server_key_iv: "5ab2294015c52cf2f8628fdae78aca2d"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.152786 6560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:07.167768 6560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:07.170379 6560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:07.170588 6560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:07.177295 6560 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:40733
I20260809 02:02:07.177583 6631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:40733 every 8 connection(s)
I20260809 02:02:07.178225 6560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:07.180990 6632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:07.184762 6632 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:07.188292 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6560
I20260809 02:02:07.188431 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:07.188771 15039 external_mini_cluster.cc:1428] Setting key 97684c36d2a8613c63dcfb0ed8ad5412
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.253@KRBTEST.COM" created.
I20260809 02:02:07.200305 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.186881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40733 (local address 127.0.0.1:33016)
0809 02:02:07.187527 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.187564 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.188617 (+ 1053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.189351 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.189359 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.189847 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.190249 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.190270 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.191779 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.191782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.192500 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.192509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.193154 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.193158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.193253 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.193901 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.193917 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.195455 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.197327 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.197337 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.197346 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.197612 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.197943 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.197946 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.197948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.198071 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.198671 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.198676 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.198818 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.199012 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.199388 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":107,"thread_start_us":170,"threads_started":1}
I20260809 02:02:07.200305 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.186881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33016 (local address 127.14.175.254:40733)
0809 02:02:07.187440 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.187459 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.187674 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:02:07.188959 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.188964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.189138 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.189283 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.190412 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.191654 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.192626 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.193001 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.193169 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.195617 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.195623 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.195632 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.195652 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.197218 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.197727 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.197732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.197734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.197841 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.198183 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.198186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.198188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.198555 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.198698 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.199064 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.199308 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"spinlock_wait_cycles":36608,"thread_start_us":177,"threads_started":1}
I20260809 02:02:07.202713 6632 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:07.203514 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.203200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55066)
0809 02:02:07.203343 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.203430 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 02:02:07.203715 6579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
I20260809 02:02:07.204573 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.204286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55074)
0809 02:02:07.204427 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.204491 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 02:02:07.204741 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:46313: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
I20260809 02:02:07.216164 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:46313
--webserver_interface=127.14.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:46547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:02:07.254021 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } attempt: 1
I20260809 02:02:07.254997 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.254604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55086)
0809 02:02:07.254761 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.254854 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 02:02:07.255821 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.255600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55096)
0809 02:02:07.255713 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.255760 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:02:07.255952 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:46313: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
I20260809 02:02:07.324128 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } attempt: 2
W20260809 02:02:07.324107 6639 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:02:07.324465 6639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:07.324528 6639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:07.324601 6639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:02:07.325001 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.324709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55110)
0809 02:02:07.324857 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.324927 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 02:02:07.325731 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.325517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55118)
0809 02:02:07.325629 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.325679 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:02:07.325848 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:46313: Network error: Client connection negotiation failed: client connection to 127.14.175.253:46313: connect: Connection refused (error 111)
W20260809 02:02:07.328871 6639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:07.328948 6639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:07.329001 6639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:07.329059 6639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:07.329098 6639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:07.334090 6639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:46547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:46313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:07.335110 6639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:07.336042 6639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:07.343959 6645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:07.343910 6647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:07.343921 6644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:07.344230 6639 server_base.cc:1034] running on GCE node
I20260809 02:02:07.344731 6639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:07.345744 6639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:07.346933 6639 hybrid_clock.cc:648] HybridClock initialized: now 1786240927346914 us; error 29 us; skew 500 ppm
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:07.349579 6639 init.cc:377] Logged in from keytab as kudu/127.14.175.253@KRBTEST.COM (short username kudu)
I20260809 02:02:07.350348 6639 webserver.cc:460] Webserver started at http://127.14.175.253:33607/ using document root <none> and password file <none>
I20260809 02:02:07.350822 6639 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:07.350878 6639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:07.351114 6639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:07.352985 6639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data/instance:
uuid: "a148786c9bad4708945be1295d4dbe9f"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "6639fbd0f7f311284b0f7e7563a71595"
server_key_iv: "fd245e6233e52a1d58dff0932465680a"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.353477 6639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal/instance:
uuid: "a148786c9bad4708945be1295d4dbe9f"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "6639fbd0f7f311284b0f7e7563a71595"
server_key_iv: "fd245e6233e52a1d58dff0932465680a"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.357154 6639 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:02:07.359403 6654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:07.360563 6639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:02:07.360702 6639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "a148786c9bad4708945be1295d4dbe9f"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "6639fbd0f7f311284b0f7e7563a71595"
server_key_iv: "fd245e6233e52a1d58dff0932465680a"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.360808 6639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:07.387115 6639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:07.389845 6639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:07.390058 6639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:07.396984 6639 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.253:46313
I20260809 02:02:07.397282 6712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.253:46313 every 8 connection(s)
I20260809 02:02:07.397959 6639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
I20260809 02:02:07.400599 6713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:07.402724 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6639
I20260809 02:02:07.402877 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-1/wal/instance
I20260809 02:02:07.403205 15039 external_mini_cluster.cc:1428] Setting key 4c13d1faddd93b026125545f498d3fbf
I20260809 02:02:07.404350 6713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.252@KRBTEST.COM" created.
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:02:07.417030 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } attempt: 3
I20260809 02:02:07.419565 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.406162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.14.175.254:40733)
0809 02:02:07.406297 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.406300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.407294 (+ 994us) server_negotiation.cc:407] Connection header received
0809 02:02:07.408190 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.408194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.408265 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.408359 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.409443 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.409982 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.411144 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.411380 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.411500 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.415516 (+ 4016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.415519 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.415521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.415545 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.417200 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.417801 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.417808 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.417810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.417905 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.418351 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.418358 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.418359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.418595 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.418706 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.419268 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.419385 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:02:07.420365 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.406627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40733 (local address 127.0.0.1:33022)
0809 02:02:07.407144 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.407185 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.407985 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.408522 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.408528 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.408842 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.409289 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.409301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.410124 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.410126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.410990 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.411024 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.411542 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.411546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.411742 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.412378 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.412394 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.415327 (+ 2933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.417325 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.417331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.417346 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.417690 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.418023 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.418029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.418034 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.418230 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.418703 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.418709 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.418948 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.419192 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.419490 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":143,"threads_started":1}
I20260809 02:02:07.421624 6713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
I20260809 02:02:07.431838 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.422123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55134)
0809 02:02:07.422326 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.422342 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.422415 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.422649 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.422652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.422812 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.422989 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.422997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.424314 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.424317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.424875 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.424884 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.425353 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.425358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.425442 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.425896 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.425917 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.427398 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.429987 (+ 2589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.429993 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.429995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.430225 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.430604 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430609 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.430611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.430714 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.431344 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.431348 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.431429 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.431545 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.431671 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":2}
I20260809 02:02:07.431947 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.417502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55126)
0809 02:02:07.417692 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.417709 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.417795 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.418395 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.418401 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.418601 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.419288 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.419303 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.420903 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.420909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.421906 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.421921 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.422906 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.422910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.423052 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.423537 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.423552 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.426814 (+ 3262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.430265 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430270 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.430275 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.430548 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.430862 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430864 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.430866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.430941 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.431394 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.431400 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.431525 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.431634 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.431776 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260809 02:02:07.431972 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.422127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55134 (local address 127.14.175.253:46313)
0809 02:02:07.422394 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.422401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.422414 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:02:07.422507 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.422511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.422546 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.422641 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.423107 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.424211 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.424986 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.425214 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.425329 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.427619 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.427622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.427625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.427667 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.429881 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430369 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.430377 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.430379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.430472 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430811 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.430815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.430820 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.431178 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.431305 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.431648 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.431771 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"spinlock_wait_cycles":1408,"thread_start_us":92,"threads_started":1}
I20260809 02:02:07.432022 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.417611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.14.175.253:46313)
0809 02:02:07.417947 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.417960 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.417995 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:02:07.418036 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.418041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.418253 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.418406 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.419447 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.420738 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.422165 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.422773 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.422901 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.426951 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.427025 (+ 74us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.427040 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.427090 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.430163 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.430675 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.430677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.430678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.430744 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.431109 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.431113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.431114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.431308 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.431393 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.431723 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.431847 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":237,"spinlock_wait_cycles":1920,"thread_start_us":127,"threads_started":1}
I20260809 02:02:07.432801 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:32829
--webserver_interface=127.14.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:46547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:02:07.433894 6632 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:07.434051 6713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:07.434690 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.434373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45072)
0809 02:02:07.434534 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.434586 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 02:02:07.434749 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.434462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45080)
0809 02:02:07.434588 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.434688 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 02:02:07.434944 6655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
I20260809 02:02:07.435530 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.435255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45090)
0809 02:02:07.435417 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.435472 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 02:02:07.435885 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.435635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45100)
0809 02:02:07.435751 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.435816 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:02:07.436002 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
W20260809 02:02:07.436059 6713 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
I20260809 02:02:07.467172 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 1
I20260809 02:02:07.468029 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.467681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45104)
0809 02:02:07.467821 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.467950 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 02:02:07.468776 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.468555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45112)
0809 02:02:07.468668 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.468718 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:02:07.468951 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
I20260809 02:02:07.485321 6713 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 1
I20260809 02:02:07.486176 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.485900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45114)
0809 02:02:07.486044 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.486103 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 02:02:07.486927 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.486729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45128)
0809 02:02:07.486824 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.486869 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:02:07.487133 6713 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
I20260809 02:02:07.544165 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 2
W20260809 02:02:07.544086 6720 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:02:07.544382 6720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:07.544449 6720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:07.544560 6720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:02:07.545060 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.544748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45130)
0809 02:02:07.544918 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.544981 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 02:02:07.545820 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.545597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45140)
0809 02:02:07.545708 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.545761 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:02:07.545943 6632 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
W20260809 02:02:07.548924 6720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:07.549000 6720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:07.549047 6720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:07.549085 6720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:07.549119 6720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:07.554280 6720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:46547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:40733,127.14.175.253:46313,127.14.175.252:32829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:32829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:07.555286 6713 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 2
I20260809 02:02:07.555369 6720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:07.556141 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.555758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45142)
0809 02:02:07.555942 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.556000 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 02:02:07.556553 6720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:02:07.556960 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.556687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45144)
0809 02:02:07.556809 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.556864 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 02:02:07.557106 6713 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:32829: Network error: Client connection negotiation failed: client connection to 127.14.175.252:32829: connect: Connection refused (error 111)
W20260809 02:02:07.564851 6727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:07.564764 6728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:07.564924 6720 server_base.cc:1034] running on GCE node
W20260809 02:02:07.565058 6730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:07.565635 6720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:07.566562 6720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:07.567714 6720 hybrid_clock.cc:648] HybridClock initialized: now 1786240927567691 us; error 37 us; skew 500 ppm
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:07.570405 6720 init.cc:377] Logged in from keytab as kudu/127.14.175.252@KRBTEST.COM (short username kudu)
I20260809 02:02:07.571269 6720 webserver.cc:460] Webserver started at http://127.14.175.252:44477/ using document root <none> and password file <none>
I20260809 02:02:07.571753 6720 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:07.571811 6720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:07.571959 6720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:07.573848 6720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data/instance:
uuid: "dd142bf2a9bc44bdae530ef01d89b53a"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "78323cc6bde2502255fea669072a77c7"
server_key_iv: "24fde2ff52ad697a780720c01637ea8f"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.574349 6720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal/instance:
uuid: "dd142bf2a9bc44bdae530ef01d89b53a"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "78323cc6bde2502255fea669072a77c7"
server_key_iv: "24fde2ff52ad697a780720c01637ea8f"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.577807 6720 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:02:07.580088 6737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:07.581247 6720 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:02:07.581403 6720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "dd142bf2a9bc44bdae530ef01d89b53a"
format_stamp: "Formatted at 2026-08-09 02:02:07 on dist-test-slave-2w3w"
server_key: "78323cc6bde2502255fea669072a77c7"
server_key_iv: "24fde2ff52ad697a780720c01637ea8f"
server_key_version: "encryptionkey@0"
I20260809 02:02:07.581508 6720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:07.608912 6720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:07.611841 6720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:07.612039 6720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:07.619207 6720 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.252:32829
I20260809 02:02:07.619560 6791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.252:32829 every 8 connection(s)
I20260809 02:02:07.620143 6720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
I20260809 02:02:07.620407 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6720
I20260809 02:02:07.620534 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786240649484061-15039-0/minicluster-data/master-2/wal/instance
I20260809 02:02:07.620919 15039 external_mini_cluster.cc:1428] Setting key 521816ec97c87a087fd48c432d005ded
I20260809 02:02:07.623229 6792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:07.627552 6792 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:02:07.636914 6795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.622332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.14.175.252:32829)
0809 02:02:07.622731 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.622749 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.622790 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:02:07.623659 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.623681 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.624055 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.624401 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.625097 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.626614 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.627717 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.628370 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.628530 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.631617 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.631622 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.631630 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.631657 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.633824 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.634316 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.634322 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.634329 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.634465 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.634750 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.634756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.634758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.635199 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.635402 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.635726 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.636017 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"spinlock_wait_cycles":8064,"thread_start_us":106,"threads_started":1}
I20260809 02:02:07.639366 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.629362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33038 (local address 127.14.175.254:40733)
0809 02:02:07.629514 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.629519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.629887 (+ 368us) server_negotiation.cc:407] Connection header received
0809 02:02:07.630059 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.630061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.630101 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.630168 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.631014 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.631726 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.633051 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.633267 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.633350 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.635843 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.635846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.635848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.635872 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.637367 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.637901 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.637904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.637905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.637980 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.638267 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.638269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.638270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.638472 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.638589 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.639047 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.639181 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:02:07.639808 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.629261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:40733 (local address 127.0.0.1:33038)
0809 02:02:07.629714 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.629778 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.629939 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.630256 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.630264 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.630698 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.630854 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.630860 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.631851 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.631855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.632909 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.632923 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.633388 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.633392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.633540 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.634054 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.634066 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.635671 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.637483 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.637494 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.637499 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.637784 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.638078 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.638081 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.638083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.638177 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.638669 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.638673 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.638772 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.638932 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.639567 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"spinlock_wait_cycles":3968,"thread_start_us":169,"threads_started":1}
I20260809 02:02:07.640832 6792 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:02:07.645098 6632 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 3
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:02:07.648273 6713 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } attempt: 3
I20260809 02:02:07.649443 6797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.639167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.14.175.254:40733)
0809 02:02:07.639530 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.639540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.639553 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:02:07.639587 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.639590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.639630 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.639726 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.640435 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.641116 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.642153 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.642514 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.642614 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.645026 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.645030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.645034 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.645060 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.646898 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.647404 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.647407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.647409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.647494 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.648053 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.648057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.648058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.648280 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.648476 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.649126 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.649244 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":141,"threads_started":1}
I20260809 02:02:07.650372 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.641280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:46313 (local address 127.0.0.1:55140)
0809 02:02:07.641396 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.641411 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.641478 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.641744 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.641747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.641906 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.642005 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.642012 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.643030 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.643033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.643946 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.643957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.644408 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.644412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.644503 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.644957 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.644974 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.646454 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.648524 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.648526 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.648528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.648765 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.649114 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.649118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.649119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.649205 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.649683 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.649686 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.649767 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.650098 (+ 331us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.650226 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 02:02:07.650657 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.641398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55140 (local address 127.14.175.253:46313)
0809 02:02:07.641532 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.641536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.641552 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:02:07.641593 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.641596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.641641 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.641706 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.642152 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.642891 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.644067 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.644287 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.644409 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.646682 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.646688 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.646691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.646719 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.648410 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.648897 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.648900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.648903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.648996 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.649318 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.649321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.649323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.649538 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.649612 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.649970 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.650443 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:02:07.651696 6792 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:07.655678 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.645737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45152)
0809 02:02:07.646148 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.646165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.646247 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.646572 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.646576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.646870 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.647007 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.647017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.647979 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.647983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.648650 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.648661 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.649274 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.649279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.649377 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.649862 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.649876 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.651361 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.653504 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.653507 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.653509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.653756 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.654052 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.654055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.654056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.654151 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.654879 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.654882 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.655021 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.655392 (+ 371us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.655535 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327}
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:02:07.656584 6795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.645809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.14.175.252:32829)
0809 02:02:07.645907 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.645910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.646361 (+ 451us) server_negotiation.cc:407] Connection header received
0809 02:02:07.646401 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.646403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.646446 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.646538 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.647144 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.647874 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.648785 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.649135 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.651545 (+ 2410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.651645 (+ 100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.651648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.651651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.651670 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.653389 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.653868 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.653871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.653873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.653943 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.654250 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.654252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.654254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.654752 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.656075 (+ 1323us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.656150 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.656235 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":257,"server-negotiator.queue_time_us":29}
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
Aug 09 02:02:07 dist-test-slave-2w3w krb5kdc[6547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240927, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:02:07.661218 6632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: Bootstrap starting.
I20260809 02:02:07.661248 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.648648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45164)
0809 02:02:07.648887 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.648899 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.648964 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.650047 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.650051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.650223 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.650337 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.650347 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.653196 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.653202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.654037 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.654047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.654735 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.654739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.654864 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.655315 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.655330 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.657285 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.659706 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.659710 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.659713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.659953 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.660261 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660264 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.660265 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.660369 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.660793 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.660796 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.660878 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.660958 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.661073 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173}
I20260809 02:02:07.661377 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.652219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:32829 (local address 127.0.0.1:45180)
0809 02:02:07.652745 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:07.652759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:07.652827 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:07.653184 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:07.653186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:07.653394 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:07.653461 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.653466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.654474 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.654480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.655437 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:07.655450 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.656105 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.656109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:07.656188 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.656576 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:07.656590 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:07.657946 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:07.660028 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.660036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.660269 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.660530 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660532 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:07.660534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:07.660597 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:07.660981 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:07.660983 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:07.661055 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 02:02:07.661128 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:02:07.661228 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":3}
I20260809 02:02:07.661533 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.650894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.14.175.253:46313)
0809 02:02:07.651043 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.651049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.651064 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:02:07.651097 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.651100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.651138 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.651215 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.651892 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.652564 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.653602 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.653944 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.654013 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.657867 (+ 3854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.657872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.657880 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.657908 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.659643 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660151 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660247 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660574 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660779 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.660935 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.661293 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.661400 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:02:07.661998 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.649093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.14.175.252:32829)
0809 02:02:07.649796 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.649804 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.649819 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:02:07.649855 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.649858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.649897 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.652087 (+ 2190us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.652194 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.653053 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.654170 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.654595 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.655093 (+ 498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.657398 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.657403 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.657405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.657428 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.659574 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660069 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660149 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660479 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660677 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.661597 (+ 920us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.661674 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.661816 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":113,"threads_started":1}
I20260809 02:02:07.662035 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.652393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.14.175.252:32829)
0809 02:02:07.653005 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.653012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.653023 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:02:07.653049 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.653052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.653085 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.653229 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.653656 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.654393 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.655569 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.655980 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.656434 (+ 454us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.658062 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.658066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.658069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.658094 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.659918 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660368 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660443 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.660688 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.660691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.660694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.660883 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.661592 (+ 709us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.661709 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.661878 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":561,"thread_start_us":73,"threads_started":1}
I20260809 02:02:07.664052 6632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:07.664809 6792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: Bootstrap starting.
I20260809 02:02:07.664855 6713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: Bootstrap starting.
I20260809 02:02:07.664984 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:02:07.665757 6632 log.cc:824] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:07.667120 6792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:07.667212 6713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:07.666329 6604 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cc9547e01545431d88f16ee407ee32f7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33050
I20260809 02:02:07.667821 6632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: No bootstrap required, opened a new log
I20260809 02:02:07.667955 6792 log.cc:824] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:07.668051 6713 log.cc:824] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:07.669864 6792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: No bootstrap required, opened a new log
I20260809 02:02:07.669945 6713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: No bootstrap required, opened a new log
I20260809 02:02:07.670822 6632 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.671065 6632 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9547e01545431d88f16ee407ee32f7, State: Initialized, Role: FOLLOWER
I20260809 02:02:07.671383 6632 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.671916 6803 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.672173 6803 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:07.672822 6632 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:07.672868 6604 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:02:07.672971 6604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:07.674449 6713 raft_consensus.cc:348] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.674481 6792 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.674701 6713 raft_consensus.cc:729] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a148786c9bad4708945be1295d4dbe9f, State: Initialized, Role: FOLLOWER
I20260809 02:02:07.674708 6792 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd142bf2a9bc44bdae530ef01d89b53a, State: Initialized, Role: FOLLOWER
I20260809 02:02:07.674788 6604 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.675038 6713 consensus_queue.cc:260] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.675052 6792 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.675683 6604 leader_election.cc:288] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [CANDIDATE]: Term 1 election: Requested vote from peers a148786c9bad4708945be1295d4dbe9f (127.14.175.253:46313), dd142bf2a9bc44bdae530ef01d89b53a (127.14.175.252:32829)
I20260809 02:02:07.676074 6818 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.676216 6818 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:07.676270 6792 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:07.676337 6713 sys_catalog.cc:564] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:07.676918 6764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9547e01545431d88f16ee407ee32f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dd142bf2a9bc44bdae530ef01d89b53a"
I20260809 02:02:07.677107 6764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:07.678426 6764 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9547e01545431d88f16ee407ee32f7 in term 1.
I20260809 02:02:07.678442 6684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9547e01545431d88f16ee407ee32f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a148786c9bad4708945be1295d4dbe9f"
I20260809 02:02:07.678655 6684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:07.678856 6576 leader_election.cc:302] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9547e01545431d88f16ee407ee32f7, dd142bf2a9bc44bdae530ef01d89b53a; no voters:
W20260809 02:02:07.679239 6817 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:07.679303 6817 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:07.679975 6684 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9547e01545431d88f16ee407ee32f7 in term 1.
I20260809 02:02:07.680164 6816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.680281 6816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:02:07.681579 6835 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:07.681675 6835 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:07.681851 6803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:07.682106 6803 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [term 1 LEADER]: Becoming Leader. State: Replica: cc9547e01545431d88f16ee407ee32f7, State: Running, Role: LEADER
I20260809 02:02:07.682426 6803 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } }
I20260809 02:02:07.685914 6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc9547e01545431d88f16ee407ee32f7. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.686137 6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:07.686671 6560 master_runner.cc:263] No leader master found from master cc9547e01545431d88f16ee407ee32f7
I20260809 02:02:07.686731 6560 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:02:07.687364 6851 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:07.688360 6851 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:07.689033 6720 master_runner.cc:263] No leader master found from master dd142bf2a9bc44bdae530ef01d89b53a
I20260809 02:02:07.689095 6720 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:02:07.693425 6764 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [term 1 FOLLOWER]: Refusing update from remote peer cc9547e01545431d88f16ee407ee32f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:02:07.694097 6849 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:02:07.697885 6818 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc9547e01545431d88f16ee407ee32f7. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.697995 6818 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:07.698871 6797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.685810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33058 (local address 127.14.175.254:40733)
0809 02:02:07.686415 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.686420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.689402 (+ 2982us) server_negotiation.cc:407] Connection header received
0809 02:02:07.689585 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.689588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.689633 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.689683 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.690721 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.691539 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.692658 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.693014 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.693088 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.695015 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.695019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.695022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.695047 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.696889 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.697409 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.697412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.697414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.697499 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.697849 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.697853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.697855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.698078 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.698201 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.698577 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.698690 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519}
I20260809 02:02:07.698916 6684 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [term 1 FOLLOWER]: Refusing update from remote peer cc9547e01545431d88f16ee407ee32f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:02:07.699440 6849 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:02:07.702682 6816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc9547e01545431d88f16ee407ee32f7. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.702816 6816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:02:07.703051 6848 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:07.703132 6848 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:07.703944 6803 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.704092 6803 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:07.704365 6818 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.704484 6818 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:07.705003 6857 mvcc.cc:205] Tried to move back new op lower bound from 7316442839825694720 to 7316442839790534656. Current Snapshot: MvccSnapshot[applied={T|T < 7316442839825694720}]
I20260809 02:02:07.706151 6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.706257 6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:07.706881 6816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cc9547e01545431d88f16ee407ee32f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9547e01545431d88f16ee407ee32f7" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 40733 } } peers { permanent_uuid: "a148786c9bad4708945be1295d4dbe9f" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 46313 } } peers { permanent_uuid: "dd142bf2a9bc44bdae530ef01d89b53a" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 32829 } } }
I20260809 02:02:07.707015 6816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:07.709746 6851 catalog_manager.cc:1347] Generated new cluster ID: 711301f143364e23a5b7685ad8f424b7
I20260809 02:02:07.709805 6851 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:07.712594 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.687854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55152 (local address 127.14.175.253:46313)
0809 02:02:07.687967 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.687972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.695611 (+ 7639us) server_negotiation.cc:407] Connection header received
0809 02:02:07.695795 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.695798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.695843 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.695892 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.696743 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.697534 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.698656 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.699124 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.699201 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.709203 (+ 10002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.709207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.709210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.709237 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.710917 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.711404 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.711407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.711409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.711482 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.711733 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.711736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.711737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.711934 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.712020 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.712339 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.712451 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:02:07.715082 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:07.687014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.14.175.252:32829)
0809 02:02:07.687137 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.687143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.691214 (+ 4071us) server_negotiation.cc:407] Connection header received
0809 02:02:07.691432 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.691435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.691477 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.691539 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.692545 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.693323 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.694482 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:07.694880 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:07.694979 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:07.709592 (+ 14613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:07.709596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:07.709599 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:07.709625 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:07.711891 (+ 2266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.712448 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.712452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.712455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.712546 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:07.712974 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:07.712978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:07.712980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:07.713206 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:07.713336 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:07.714730 (+ 1394us) server_negotiation.cc:299] Negotiation successful
0809 02:02:07.714890 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:02:07.731182 6851 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:07.732398 6851 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:07.751171 6851 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc9547e01545431d88f16ee407ee32f7: Generated new TSK 0
I20260809 02:02:07.751914 6851 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:02:07.785787 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.782760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55160 (local address 127.14.175.253:46313)
0809 02:02:07.782916 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.782921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.784669 (+ 1748us) server_negotiation.cc:407] Connection header received
0809 02:02:07.784860 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.784864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.784914 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.784969 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.785657 (+ 688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55160: BlockingRecv error: recv got EOF from 127.0.0.1:55160 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:02:07.787115 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.783598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.14.175.254:40733)
0809 02:02:07.783750 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.783755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.786231 (+ 2476us) server_negotiation.cc:407] Connection header received
0809 02:02:07.786401 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.786404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.786449 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.786498 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.787007 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33070: BlockingRecv error: recv got EOF from 127.0.0.1:33070 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 02:02:07.788426 6799 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.784099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45188 (local address 127.14.175.252:32829)
0809 02:02:07.784209 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.784213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.787571 (+ 3358us) server_negotiation.cc:407] Connection header received
0809 02:02:07.787740 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.787743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.787787 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.787834 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.788303 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45188: BlockingRecv error: recv got EOF from 127.0.0.1:45188 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:02:07.794726 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.793179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.14.175.253:46313)
0809 02:02:07.793279 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.793283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.793750 (+ 467us) server_negotiation.cc:407] Connection header received
0809 02:02:07.793965 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.793968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.794041 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.794093 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.794606 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55166: BlockingRecv error: recv got EOF from 127.0.0.1:55166 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 02:02:07.799759 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.798226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55180 (local address 127.14.175.253:46313)
0809 02:02:07.798322 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.798326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.798824 (+ 498us) server_negotiation.cc:407] Connection header received
0809 02:02:07.799078 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.799081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.799131 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.799180 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.799662 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55180: BlockingRecv error: recv got EOF from 127.0.0.1:55180 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:02:07.806416 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.804963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55194 (local address 127.14.175.253:46313)
0809 02:02:07.805058 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.805061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.805570 (+ 509us) server_negotiation.cc:407] Connection header received
0809 02:02:07.805744 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.805747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.805798 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.805847 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.806310 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55194: BlockingRecv error: recv got EOF from 127.0.0.1:55194 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 02:02:07.813817 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.812314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55208 (local address 127.14.175.253:46313)
0809 02:02:07.812461 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.812465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.812990 (+ 525us) server_negotiation.cc:407] Connection header received
0809 02:02:07.813163 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.813166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.813210 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.813258 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.813726 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55208: BlockingRecv error: recv got EOF from 127.0.0.1:55208 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 02:02:07.825400 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.823846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55210 (local address 127.14.175.253:46313)
0809 02:02:07.823952 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.823957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.824496 (+ 539us) server_negotiation.cc:407] Connection header received
0809 02:02:07.824679 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.824683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.824733 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.824784 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.825291 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55210: BlockingRecv error: recv got EOF from 127.0.0.1:55210 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 02:02:07.845748 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.843910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55212 (local address 127.14.175.253:46313)
0809 02:02:07.844032 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.844037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.844657 (+ 620us) server_negotiation.cc:407] Connection header received
0809 02:02:07.844878 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.844882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.844947 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.845007 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.845626 (+ 619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55212: BlockingRecv error: recv got EOF from 127.0.0.1:55212 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 02:02:07.896396 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.886772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.14.175.253:46313)
0809 02:02:07.886898 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.886903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.895333 (+ 8430us) server_negotiation.cc:407] Connection header received
0809 02:02:07.895528 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.895533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.895594 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.895686 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.896245 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55224: BlockingRecv error: recv got EOF from 127.0.0.1:55224 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 02:02:07.964175 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:07.962731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55240 (local address 127.14.175.253:46313)
0809 02:02:07.962874 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:07.962879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:07.963061 (+ 182us) server_negotiation.cc:407] Connection header received
0809 02:02:07.963274 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:07.963278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:07.963332 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:07.963413 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:07.964033 (+ 620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55240: BlockingRecv error: recv got EOF from 127.0.0.1:55240 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:02:08.095489 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:08.094123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55248 (local address 127.14.175.253:46313)
0809 02:02:08.094299 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.094304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.094435 (+ 131us) server_negotiation.cc:407] Connection header received
0809 02:02:08.094617 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.094627 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.094675 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.094779 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:08.095360 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55248: BlockingRecv error: recv got EOF from 127.0.0.1:55248 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:02:08.354723 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:08.353611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.14.175.253:46313)
0809 02:02:08.353771 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.353777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.353797 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:02:08.353994 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.353997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.354044 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.354135 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:08.354598 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55258: BlockingRecv error: recv got EOF from 127.0.0.1:55258 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 02:02:08.682919 6835 catalog_manager.cc:1259] Loaded cluster ID: 711301f143364e23a5b7685ad8f424b7
I20260809 02:02:08.683023 6835 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: loading cluster ID for follower catalog manager: success
I20260809 02:02:08.684795 6835 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: acquiring CA information for follower catalog manager: success
I20260809 02:02:08.686379 6835 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd142bf2a9bc44bdae530ef01d89b53a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:02:08.704375 6848 catalog_manager.cc:1259] Loaded cluster ID: 711301f143364e23a5b7685ad8f424b7
I20260809 02:02:08.704485 6848 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: loading cluster ID for follower catalog manager: success
I20260809 02:02:08.706092 6848 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: acquiring CA information for follower catalog manager: success
I20260809 02:02:08.707253 6848 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a148786c9bad4708945be1295d4dbe9f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:02:08.873395 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:08.868904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55846 (local address 127.14.175.253:46313)
0809 02:02:08.869182 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.869191 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.869253 (+ 62us) server_negotiation.cc:407] Connection header received
0809 02:02:08.869457 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.869460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.869589 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.869714 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:08.869993 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.870719 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.871742 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.871981 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.872103 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:08.872460 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:08.872894 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:08.873045 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:08.873084 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 02:02:08.873143 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":97,"threads_started":1}
I20260809 02:02:08.880193 6939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:08.876665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39450 (local address 127.14.175.252:32829)
0809 02:02:08.876906 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.876909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.876924 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:02:08.876999 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.877001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.877106 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.877286 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:08.877469 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.878025 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.878875 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.879110 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.879190 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:08.879435 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:08.879849 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:08.879989 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:08.880037 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 02:02:08.880081 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":93,"threads_started":1}
I20260809 02:02:08.887655 6946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:08.883028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47868 (local address 127.14.175.254:40733)
0809 02:02:08.883374 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.883379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.883396 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:02:08.883631 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.883635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.883798 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.883946 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:08.884156 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.884963 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.885915 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.886399 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.886548 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:08.886887 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:08.887234 (+ 347us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:08.887322 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:08.887421 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 02:02:08.887500 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":77,"threads_started":1}
I20260809 02:02:08.887688 6939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:08.883426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39462 (local address 127.14.175.252:32829)
0809 02:02:08.883531 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.883535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.884152 (+ 617us) server_negotiation.cc:407] Connection header received
0809 02:02:08.884194 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.884197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.884241 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.884305 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:08.884644 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.885292 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.886353 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.886812 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.886917 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:08.887214 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:08.887303 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:08.887359 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:08.887534 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:02:08.887582 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:02:08.888504 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:08.883289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.14.175.253:46313)
0809 02:02:08.883393 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:08.883397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:08.883653 (+ 256us) server_negotiation.cc:407] Connection header received
0809 02:02:08.883828 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:08.883833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:08.883901 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:08.883972 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:08.884291 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.884970 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.887153 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:08.887479 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:08.887604 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:08.888003 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:08.888083 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:08.888130 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:08.888315 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 02:02:08.888366 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:02:08.896239 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6560
I20260809 02:02:08.904052 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6639
I20260809 02:02:08.911301 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6720
2026-08-09T02:02:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3115 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:02:08 dist-test-slave-2w3w krb5kdc[6951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:02:08 dist-test-slave-2w3w krb5kdc[6951](info): set up 2 sockets
Aug 09 02:02:08 dist-test-slave-2w3w krb5kdc[6951](info): commencing operation
krb5kdc: starting...
W20260809 02:02:09.994275 15039 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/test-user.keytab.
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:02:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:02:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
Entry for principal kudu/127.14.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab.
I20260809 02:02:10.118103 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39351
--webserver_interface=127.14.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:10.225912 6965 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:02:10.226226 6965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:10.226301 6965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:10.226379 6965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:10.230406 6965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:10.230487 6965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:10.230526 6965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:10.230584 6965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:10.230623 6965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:10.235740 6965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.254.keytab
--principal=kudu/127.14.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.254:39351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:10.236697 6965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:10.237646 6965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:10.245786 6972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.245995 6965 server_base.cc:1034] running on GCE node
W20260809 02:02:10.245850 6974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:10.246057 6971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.246745 6965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:10.248095 6965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:10.249292 6965 hybrid_clock.cc:648] HybridClock initialized: now 1786240930249268 us; error 37 us; skew 500 ppm
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:10.251964 6965 init.cc:377] Logged in from keytab as kudu/127.14.175.254@KRBTEST.COM (short username kudu)
I20260809 02:02:10.252776 6965 webserver.cc:460] Webserver started at http://127.14.175.254:41703/ using document root <none> and password file <none>
I20260809 02:02:10.253305 6965 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:10.253399 6965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:10.253619 6965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:10.255621 6965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data/instance:
uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "9c59d084ab795e92233dac0179796168"
server_key_iv: "9a7aa4ed2d6026601ae547c667ff842f"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.256172 6965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance:
uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "9c59d084ab795e92233dac0179796168"
server_key_iv: "9a7aa4ed2d6026601ae547c667ff842f"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.259672 6965 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:02:10.262001 6981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:10.263186 6965 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:02:10.263329 6965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal
uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "9c59d084ab795e92233dac0179796168"
server_key_iv: "9a7aa4ed2d6026601ae547c667ff842f"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.263437 6965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:10.285089 6965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:10.287853 6965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:10.288064 6965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:10.295115 6965 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.254:39351
I20260809 02:02:10.295416 7035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.254:39351 every 8 connection(s)
I20260809 02:02:10.296083 6965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/data/info.pb
I20260809 02:02:10.298733 7036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:10.302313 7036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.304083 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 6965
I20260809 02:02:10.304210 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-0/wal/instance
I20260809 02:02:10.304502 15039 external_mini_cluster.cc:1428] Setting key b673faae815374b80917862b53534b42
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.253@KRBTEST.COM" created.
I20260809 02:02:10.318912 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.305332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.14.175.254:39351)
0809 02:02:10.305590 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.305600 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.305635 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:02:10.306872 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.306880 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.307179 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.307392 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.308154 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.309646 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.311028 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.311425 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.311553 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.314261 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.314268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.314282 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.314311 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.315939 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.316395 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.316399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.316400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.316500 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.316839 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.316841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.316842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.317312 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.317444 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.317917 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.318144 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":159,"thread_start_us":94,"threads_started":1}
I20260809 02:02:10.318917 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.304634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39351 (local address 127.0.0.1:51830)
0809 02:02:10.305162 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.305221 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.306496 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.307380 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.307384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.307699 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.307997 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.308010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.309812 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.309817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.310804 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.310820 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.311599 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.311605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.311772 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.312401 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.312426 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.314105 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.316039 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.316048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.316055 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.316284 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.316618 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.316624 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.316626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.316759 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.317444 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.317449 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.317617 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.317815 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.318251 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":86,"thread_start_us":118,"threads_started":1}
I20260809 02:02:10.321535 7036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.322362 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.322018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47070)
0809 02:02:10.322171 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.322273 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 02:02:10.322592 6984 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
I20260809 02:02:10.323549 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.323263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47074)
0809 02:02:10.323405 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.323466 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:02:10.323710 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:37115: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
Entry for principal kudu/127.14.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab.
I20260809 02:02:10.333904 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:37115
--webserver_interface=127.14.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:02:10.372970 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } attempt: 1
I20260809 02:02:10.373844 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.373539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47080)
0809 02:02:10.373701 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.373765 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 02:02:10.374617 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.374433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47096)
0809 02:02:10.374524 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.374566 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:02:10.374852 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:37115: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
I20260809 02:02:10.443032 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } attempt: 2
W20260809 02:02:10.443638 7043 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
I20260809 02:02:10.443845 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.443563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47108)
0809 02:02:10.443707 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.443770 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 02:02:10.443918 7043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:10.444020 7043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:10.444084 7043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:02:10.444587 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.444399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47120)
0809 02:02:10.444492 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.444537 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 02:02:10.444733 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.253:37115: Network error: Client connection negotiation failed: client connection to 127.14.175.253:37115: connect: Connection refused (error 111)
W20260809 02:02:10.448338 7043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:10.448385 7043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:10.448405 7043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:10.448462 7043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:10.448495 7043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:10.453465 7043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.253.keytab
--principal=kudu/127.14.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.253:37115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:10.454352 7043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:10.455366 7043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:10.463433 7049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:10.463481 7051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.463495 7043 server_base.cc:1034] running on GCE node
W20260809 02:02:10.463447 7048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.464174 7043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:10.465200 7043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:10.466360 7043 hybrid_clock.cc:648] HybridClock initialized: now 1786240930466330 us; error 41 us; skew 500 ppm
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:10.469226 7043 init.cc:377] Logged in from keytab as kudu/127.14.175.253@KRBTEST.COM (short username kudu)
I20260809 02:02:10.470086 7043 webserver.cc:460] Webserver started at http://127.14.175.253:33057/ using document root <none> and password file <none>
I20260809 02:02:10.470613 7043 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:10.470674 7043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:10.470901 7043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:10.472863 7043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data/instance:
uuid: "0a035ccd7c2a4182a70ef394adb3b9c8"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "e12420280d76e6178f1453f4de4d725d"
server_key_iv: "77c1376ba0f5504640b767cdf7fd37c1"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.473404 7043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal/instance:
uuid: "0a035ccd7c2a4182a70ef394adb3b9c8"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "e12420280d76e6178f1453f4de4d725d"
server_key_iv: "77c1376ba0f5504640b767cdf7fd37c1"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.477181 7043 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260809 02:02:10.479552 7058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:10.480682 7043 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:02:10.480822 7043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal
uuid: "0a035ccd7c2a4182a70ef394adb3b9c8"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "e12420280d76e6178f1453f4de4d725d"
server_key_iv: "77c1376ba0f5504640b767cdf7fd37c1"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.480922 7043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:10.491161 7043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:10.493775 7043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:10.493970 7043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:10.500996 7043 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.253:37115
I20260809 02:02:10.501273 7112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.253:37115 every 8 connection(s)
I20260809 02:02:10.501933 7043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/data/info.pb
I20260809 02:02:10.504575 7113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:10.508116 7113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.509938 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 7043
I20260809 02:02:10.510074 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-1/wal/instance
I20260809 02:02:10.510386 15039 external_mini_cluster.cc:1428] Setting key cb0e0a02275ccc3da53e79def4675877
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.175.252@KRBTEST.COM" created.
I20260809 02:02:10.521597 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.509855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51834 (local address 127.14.175.254:39351)
0809 02:02:10.510019 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.510024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.510907 (+ 883us) server_negotiation.cc:407] Connection header received
0809 02:02:10.511895 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.511899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.511961 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.512045 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.513173 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.513720 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.514925 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.515223 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.515344 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.517784 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.517788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.517790 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.517814 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.519399 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.519958 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.519961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.519962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.520040 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.520373 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.520376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.520378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.520580 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.520681 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.521251 (+ 570us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.521400 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:02:10.522454 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.510254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39351 (local address 127.0.0.1:51834)
0809 02:02:10.510740 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.510783 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.511684 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.512204 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.512210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.512570 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.513018 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.513030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.513857 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.513861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.514786 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.514799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.515387 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.515392 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.515556 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.516194 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.516210 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.517612 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.519508 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.519513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.519524 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.519839 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.520119 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.520121 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.520122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.520251 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.520683 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.520688 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.521013 (+ 325us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.521167 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.521439 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":157,"threads_started":1}
I20260809 02:02:10.523852 7113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:02:10.532881 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.524310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47124)
0809 02:02:10.524439 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.524454 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.524531 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.525102 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.525104 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.525269 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.525343 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.525348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.526389 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.526392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.526915 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.526923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.527546 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.527549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.527665 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.528136 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.528147 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.529566 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.531312 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.531315 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.531316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.531620 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.531918 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.531920 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.531921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.532003 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.532470 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.532472 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.532547 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.532657 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.532770 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":17}
I20260809 02:02:10.533057 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.524496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.14.175.253:37115)
0809 02:02:10.524790 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.524797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.524815 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:02:10.524846 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.524849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.524977 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.525123 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.525450 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.526262 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.527079 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.527428 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.527548 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.529696 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.529705 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.529714 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.529734 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.531193 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.531751 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.531755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.531757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.531832 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.532142 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.532148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.532150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.532379 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.532480 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.532758 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.532872 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":215,"thread_start_us":126,"threads_started":1}
I20260809 02:02:10.534703 7113 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.535524 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.535250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49784)
0809 02:02:10.535356 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.535475 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:02:10.535728 7061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
I20260809 02:02:10.535903 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
Entry for principal kudu/127.14.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab.
I20260809 02:02:10.536695 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.536489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49794)
0809 02:02:10.536581 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.536629 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:02:10.537387 15039 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
/tmp/dist-test-taskXh4dFo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:45681
--webserver_interface=127.14.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.175.212:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:02:10.538892 7113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:02:10.546463 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.536309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47126)
0809 02:02:10.536640 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.536653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.536736 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.537122 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.537125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.537304 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.537424 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.537432 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.538212 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.538218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.539481 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.539491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.540965 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.540968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.541048 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.541542 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.541562 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.542766 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.545048 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.545050 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.545052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.545244 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.545576 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.545578 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.545579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.545651 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.546104 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.546106 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.546179 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.546256 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.546353 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257}
I20260809 02:02:10.546691 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.536345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47126 (local address 127.14.175.253:37115)
0809 02:02:10.536879 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.536883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.536894 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:02:10.536943 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.536945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.536978 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.537061 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.537559 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.538095 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.539596 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.540804 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.540935 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.543141 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.543147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.543150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.543180 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.544925 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.545358 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.545365 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.545369 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.545465 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.545744 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.545750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.545755 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.545999 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.546108 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.546347 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.546474 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471}
I20260809 02:02:10.547429 7036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.548055 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.547837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49806)
0809 02:02:10.547946 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.548003 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:02:10.548866 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.548618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49814)
0809 02:02:10.548770 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.548811 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260809 02:02:10.549067 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
I20260809 02:02:10.580233 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 1
I20260809 02:02:10.581030 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.580721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49816)
0809 02:02:10.580892 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.580959 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 02:02:10.581749 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.581548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49830)
0809 02:02:10.581652 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.581696 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 02:02:10.581930 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
I20260809 02:02:10.588148 7113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 1
I20260809 02:02:10.588865 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.588568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49844)
0809 02:02:10.588718 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.588782 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 02:02:10.589655 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.589384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49850)
0809 02:02:10.589516 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.589582 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:02:10.589934 7113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
W20260809 02:02:10.648831 7121 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:02:10.649123 7121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:02:10.649195 7121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:02:10.649269 7121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:02:10.653146 7121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:02:10.653239 7121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:02:10.653288 7121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:02:10.653324 7121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:02:10.653353 7121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:02:10.657111 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 2
I20260809 02:02:10.657922 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.657642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49860)
0809 02:02:10.657782 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.657844 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 02:02:10.658114 7113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 2
I20260809 02:02:10.658680 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.658449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49870)
0809 02:02:10.658572 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.658623 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:02:10.658771 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.658491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49882)
0809 02:02:10.658631 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.658677 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 02:02:10.658849 7036 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
I20260809 02:02:10.658931 7121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.175.212:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.175.254:39351,127.14.175.253:37115,127.14.175.252:45681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/krb5kdc/kudu_127.14.175.252.keytab
--principal=kudu/127.14.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.175.252:45681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:21:56 UTC on ccycloud.quasar-xrrvkm.root.comops.site
build id 4575763
I20260809 02:02:10.659490 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.659260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49892)
0809 02:02:10.659373 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.659420 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:02:10.659709 7113 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.175.252:45681: Network error: Client connection negotiation failed: client connection to 127.14.175.252:45681: connect: Connection refused (error 111)
I20260809 02:02:10.660102 7121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:02:10.660975 7121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:02:10.669096 7127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:02:10.669137 7126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.669265 7121 server_base.cc:1034] running on GCE node
W20260809 02:02:10.669147 7129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:02:10.669937 7121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:02:10.671072 7121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:02:10.672253 7121 hybrid_clock.cc:648] HybridClock initialized: now 1786240930672227 us; error 44 us; skew 500 ppm
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:02:10.674999 7121 init.cc:377] Logged in from keytab as kudu/127.14.175.252@KRBTEST.COM (short username kudu)
I20260809 02:02:10.675819 7121 webserver.cc:460] Webserver started at http://127.14.175.252:33427/ using document root <none> and password file <none>
I20260809 02:02:10.676345 7121 fs_manager.cc:359] Metadata directory not provided
I20260809 02:02:10.676436 7121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:02:10.676656 7121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:02:10.678553 7121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data/instance:
uuid: "8c81f22707ea450b8a91f71122e5ee07"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "5cb48dd6c002ded90ef9194574d1842b"
server_key_iv: "72ead10b2f68faacd1bcdaedf62330cc"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.679169 7121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal/instance:
uuid: "8c81f22707ea450b8a91f71122e5ee07"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "5cb48dd6c002ded90ef9194574d1842b"
server_key_iv: "72ead10b2f68faacd1bcdaedf62330cc"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.682720 7121 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:02:10.685159 7138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:02:10.686350 7121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:02:10.686491 7121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data,/tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal
uuid: "8c81f22707ea450b8a91f71122e5ee07"
format_stamp: "Formatted at 2026-08-09 02:02:10 on dist-test-slave-2w3w"
server_key: "5cb48dd6c002ded90ef9194574d1842b"
server_key_iv: "72ead10b2f68faacd1bcdaedf62330cc"
server_key_version: "encryptionkey@0"
I20260809 02:02:10.686609 7121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:02:10.722437 7121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:02:10.725443 7121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:02:10.725657 7121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:02:10.732847 7121 rpc_server.cc:307] RPC server started. Bound to: 127.14.175.252:45681
I20260809 02:02:10.733165 7191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.175.252:45681 every 8 connection(s)
I20260809 02:02:10.733788 7121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/data/info.pb
I20260809 02:02:10.734746 15039 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu as pid 7121
I20260809 02:02:10.734896 15039 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXh4dFo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786240649484061-15039-0/minicluster-data/master-2/wal/instance
I20260809 02:02:10.735234 15039 external_mini_cluster.cc:1428] Setting key 769ea7fcea28f4f324d3336f5efbae01
I20260809 02:02:10.736994 7192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:02:10.741171 7192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
I20260809 02:02:10.749876 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.736461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49896 (local address 127.14.175.252:45681)
0809 02:02:10.736848 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.736863 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.736896 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:02:10.737554 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.737570 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.737899 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.738146 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.739082 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.740054 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.741385 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.741930 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.742054 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.744926 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.744931 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.744938 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.744962 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.746822 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.747388 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.747394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.747399 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.747517 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.747834 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.747838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.747839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.748166 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.748363 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.748653 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.748914 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":129,"threads_started":1}
I20260809 02:02:10.751044 7113 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 3
I20260809 02:02:10.752839 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.743174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.14.175.254:39351)
0809 02:02:10.743336 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.743344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.743642 (+ 298us) server_negotiation.cc:407] Connection header received
0809 02:02:10.743763 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.743766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.743838 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.743933 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.744605 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.745257 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.746307 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.746652 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.746769 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.749152 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.749156 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.749159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.749183 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.750749 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.751313 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.751317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.751318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.751414 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.751787 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.751791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.751792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.752048 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.752140 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.752584 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.752694 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:02:10.753379 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.743111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.254:39351 (local address 127.0.0.1:51846)
0809 02:02:10.743505 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.743552 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.743665 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.743984 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.743988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.744319 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.744476 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.744481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.745426 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.745431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.746186 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.746196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.746776 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.746779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.746947 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.747442 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.747455 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.749022 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.750893 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.750899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.750903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.751212 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.751545 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.751550 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.751554 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.751642 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.752196 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.752204 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.752336 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.753008 (+ 672us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.753167 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":166,"threads_started":1}
I20260809 02:02:10.754372 7192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.253@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:02:10.758000 7036 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } attempt: 3
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.254@KRBTEST.COM
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
I20260809 02:02:10.760458 7115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.751527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49906)
0809 02:02:10.751727 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.751743 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.751826 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.752105 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.752111 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.752295 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.752399 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.752405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.753319 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.753323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.754121 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.754132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.754704 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.754708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.754847 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.755340 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.755352 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.756639 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.758584 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.758588 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.758590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.758865 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.759235 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.759238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.759240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.759351 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.759873 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.759879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.759991 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.760096 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.760236 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 02:02:10.761010 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.751567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.14.175.252:45681)
0809 02:02:10.751673 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.751677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.751905 (+ 228us) server_negotiation.cc:407] Connection header received
0809 02:02:10.751939 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.751941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.751977 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.752050 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.752521 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.753186 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.754238 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.754590 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.754699 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.756798 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.756804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.756806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.756839 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.758457 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.759026 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.759030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.759032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.759123 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.759489 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.759493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.759494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.759711 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.760658 (+ 947us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.760740 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.760853 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37,"spinlock_wait_cycles":3840}
I20260809 02:02:10.764379 7197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.752259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51858 (local address 127.14.175.254:39351)
0809 02:02:10.752624 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.752631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.752641 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:02:10.752667 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.752669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.752698 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.752792 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.753472 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.754205 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.755838 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.756234 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.756363 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.759279 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.759285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.759290 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.759312 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.761625 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.762445 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.762450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.762451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.762532 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.762838 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.762841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.762842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.763051 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.763239 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.764093 (+ 854us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.764202 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":132,"threads_started":1}
I20260809 02:02:10.764546 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.755084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47138 (local address 127.14.175.253:37115)
0809 02:02:10.755350 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.755354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.755367 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:02:10.755399 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.755402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.755438 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.755510 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.756025 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.756560 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.757795 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.758045 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.758141 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.760961 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.760964 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.760967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.760991 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.762601 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.763095 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.763101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.763106 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.763194 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.763524 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.763527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.763529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.763809 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.763897 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.764236 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.764404 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260809 02:02:10.764572 7113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: Bootstrap starting.
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.254@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:02:10.766458 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.754847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.253:37115 (local address 127.0.0.1:47138)
0809 02:02:10.754995 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.755011 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.755080 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.755607 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.755610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.755792 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.755916 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.755921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.756663 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.756668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.757472 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.757481 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.758265 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.758272 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.758387 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.758827 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.758840 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.760470 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.762698 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.762700 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.762702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.762943 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.763304 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.763307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.763318 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.763412 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.763956 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.763961 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.764041 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.766137 (+ 2096us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.766274 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"spinlock_wait_cycles":7424}
I20260809 02:02:10.767266 7192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:02:10.767513 7113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:10.768483 7113 log.cc:824] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:10.769817 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.758358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49910)
0809 02:02:10.758600 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.758614 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.758692 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.760230 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.760233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.760425 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.760520 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.760529 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.761634 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.761639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.762480 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.762493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.763192 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.763196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.763298 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.763750 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.763762 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.766019 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.768208 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.768229 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.768231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.768501 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.768832 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.768835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.768837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.768930 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.769322 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.769327 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.769417 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.769514 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.769647 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260809 02:02:10.770511 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.758841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.14.175.252:45681)
0809 02:02:10.759253 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.759269 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.759285 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:02:10.760019 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.760023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.760087 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.760648 (+ 561us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.760742 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.761499 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.762636 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.763070 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.763510 (+ 440us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.766164 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.766167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.766170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.766194 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.768097 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.768637 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.768640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.768642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.768726 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.769026 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.769028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.769030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.769196 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.770156 (+ 960us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.770230 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.770344 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":134,"threads_started":1}
I20260809 02:02:10.771176 7113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: No bootstrap required, opened a new log
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.175.253@KRBTEST.COM
Aug 09 02:02:10 dist-test-slave-2w3w krb5kdc[6951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786240930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.175.252@KRBTEST.COM for kudu/127.14.175.252@KRBTEST.COM
I20260809 02:02:10.773377 7036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: Bootstrap starting.
I20260809 02:02:10.775154 7113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.775363 7113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a035ccd7c2a4182a70ef394adb3b9c8, State: Initialized, Role: FOLLOWER
I20260809 02:02:10.775666 7113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.775815 7036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:10.776575 7036 log.cc:824] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:10.776935 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.767720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.175.252:45681 (local address 127.0.0.1:49924)
0809 02:02:10.767871 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:02:10.767882 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:02:10.767942 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:02:10.768770 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:02:10.768773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:02:10.768948 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:02:10.769030 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.769036 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.769932 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.769935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.770786 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:02:10.770800 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.771552 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.771555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:02:10.771643 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.772067 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:02:10.772082 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:02:10.773462 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:02:10.775415 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.775420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.775425 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.775658 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.775952 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:02:10.775955 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:02:10.775956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:02:10.776034 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:02:10.776450 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:02:10.776452 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:02:10.776532 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 02:02:10.776634 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:02:10.776764 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 02:02:10.777009 7113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:10.777132 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.765765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.14.175.253:37115)
0809 02:02:10.765870 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.765874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.765935 (+ 61us) server_negotiation.cc:407] Connection header received
0809 02:02:10.766062 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.766068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.766118 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.766188 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.767468 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.768139 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.769307 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.769626 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.769710 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.772873 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.772878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.772882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.772910 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.774806 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.775376 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.775381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.775382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.775469 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.775783 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.775786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.775788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.775994 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.776173 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.776816 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.776923 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:02:10.777405 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.768409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.14.175.252:45681)
0809 02:02:10.768512 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.768516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.768528 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:02:10.768562 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.768568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.768611 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.768685 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.769138 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.769829 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.770941 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.771349 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.771460 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.773607 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.773613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.773618 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.773645 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.775314 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.775765 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.775769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.775771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.775858 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.776127 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.776129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.776131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.776319 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.776417 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.777163 (+ 746us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.777281 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:02:10.779111 7036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: No bootstrap required, opened a new log
I20260809 02:02:10.780149 7192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: Bootstrap starting.
I20260809 02:02:10.781157 15039 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:02:10.782209 7192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: Neither blocks nor log segments found. Creating new log.
I20260809 02:02:10.783381 7192 log.cc:824] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: Log is configured to *not* fsync() on all Append() calls
I20260809 02:02:10.783641 7200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.783854 7200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:02:10.784870 7212 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:10.784950 7212 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:10.781486 7043 master_runner.cc:186] Error getting master registration for 127.14.175.254:39351: OK, instance_id { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" instance_seqno: 1786240930293121 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:02:10.785068 7043 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:02:10.782562 7010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51858
I20260809 02:02:10.787003 7036 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.787225 7036 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9c1eeb84ffe4c23a70e297ac18f66f5, State: Initialized, Role: FOLLOWER
I20260809 02:02:10.787542 7036 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.788087 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.788295 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.788748 7036 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:10.788843 7010 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:02:10.788965 7192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: No bootstrap required, opened a new log
I20260809 02:02:10.788976 7010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 0 FOLLOWER]: Advancing to term 1
W20260809 02:02:10.789598 6988 tablet.cc:2369] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:02:10.790849 7010 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.791836 7010 leader_election.cc:288] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [CANDIDATE]: Term 1 election: Requested vote from peers 0a035ccd7c2a4182a70ef394adb3b9c8 (127.14.175.253:37115), 8c81f22707ea450b8a91f71122e5ee07 (127.14.175.252:45681)
I20260809 02:02:10.793157 7086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8"
I20260809 02:02:10.793371 7086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:10.793692 7192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.793962 7192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c81f22707ea450b8a91f71122e5ee07, State: Initialized, Role: FOLLOWER
I20260809 02:02:10.794306 7192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.794617 7086 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9c1eeb84ffe4c23a70e297ac18f66f5 in term 1.
I20260809 02:02:10.795511 6984 leader_election.cc:302] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a035ccd7c2a4182a70ef394adb3b9c8, c9c1eeb84ffe4c23a70e297ac18f66f5; no voters:
I20260809 02:02:10.795796 7192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:02:10.795832 7166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8c81f22707ea450b8a91f71122e5ee07"
I20260809 02:02:10.796022 7166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:02:10.797833 7166 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9c1eeb84ffe4c23a70e297ac18f66f5 in term 1.
I20260809 02:02:10.798106 7215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:02:10.798362 7215 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [term 1 LEADER]: Becoming Leader. State: Replica: c9c1eeb84ffe4c23a70e297ac18f66f5, State: Running, Role: LEADER
I20260809 02:02:10.798764 7215 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } }
I20260809 02:02:10.799036 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.799160 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.801097 6965 master_runner.cc:263] No leader master found from master c9c1eeb84ffe4c23a70e297ac18f66f5
I20260809 02:02:10.801159 6965 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 02:02:10.802049 7247 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:10.802125 7247 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:10.802881 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9c1eeb84ffe4c23a70e297ac18f66f5. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.803053 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: This master's current role is: LEADER
W20260809 02:02:10.805688 7229 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:02:10.805761 7229 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:02:10.811734 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.794900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47152 (local address 127.14.175.253:37115)
0809 02:02:10.795094 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.795098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.802476 (+ 7378us) server_negotiation.cc:407] Connection header received
0809 02:02:10.802689 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.802694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.802741 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.802798 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.803954 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.804718 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.805542 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.805859 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.805962 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.807932 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.807936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.807939 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.807965 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.809759 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.810296 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.810299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.810301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.810388 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.810699 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.810703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.810705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.810931 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.811090 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.811456 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.811578 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260809 02:02:10.815212 7252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:02:10.816190 7252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:02:10.822290 7197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.807288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51862 (local address 127.14.175.254:39351)
0809 02:02:10.807407 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.807411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.811401 (+ 3990us) server_negotiation.cc:407] Connection header received
0809 02:02:10.812512 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.812515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.812562 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.812611 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.813536 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.814374 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.815560 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.815919 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.815998 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.817893 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.817896 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.817899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.817925 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.820336 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.820875 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.820879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.820881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.820978 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.821291 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.821294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.821296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.821510 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.821612 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.821994 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.822124 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:02:10.822844 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:10.794550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.14.175.252:45681)
0809 02:02:10.794666 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.794672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.807942 (+ 13270us) server_negotiation.cc:407] Connection header received
0809 02:02:10.808118 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.808121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.808167 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.808219 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.809068 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.809819 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.813543 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:10.813877 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:10.813956 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:10.815737 (+ 1781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:02:10.815741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:02:10.815744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:02:10.815769 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:02:10.817514 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.818006 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.818009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.818011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.818098 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:02:10.818412 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:02:10.818415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:02:10.818417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:02:10.818630 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:02:10.818742 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:10.822573 (+ 3831us) server_negotiation.cc:299] Negotiation successful
0809 02:02:10.822693 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:02:10.830925 7166 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [term 1 FOLLOWER]: Refusing update from remote peer c9c1eeb84ffe4c23a70e297ac18f66f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:02:10.831809 7086 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [term 1 FOLLOWER]: Refusing update from remote peer c9c1eeb84ffe4c23a70e297ac18f66f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:02:10.832495 7248 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:02:10.832762 7215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:02:10.836550 7200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9c1eeb84ffe4c23a70e297ac18f66f5. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.836673 7200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.836992 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9c1eeb84ffe4c23a70e297ac18f66f5. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.837112 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.847148 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.847276 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:10.848244 7200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.848364 7200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.848626 7254 mvcc.cc:205] Tried to move back new op lower bound from 7316442852674834432 to 7316442852555702272. Current Snapshot: MvccSnapshot[applied={T|T < 7316442852674834432}]
I20260809 02:02:10.848896 7257 mvcc.cc:205] Tried to move back new op lower bound from 7316442852674834432 to 7316442852555702272. Current Snapshot: MvccSnapshot[applied={T|T < 7316442852674834432}]
I20260809 02:02:10.852523 7248 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.852648 7248 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:02:10.853678 7235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9c1eeb84ffe4c23a70e297ac18f66f5" member_type: VOTER last_known_addr { host: "127.14.175.254" port: 39351 } } peers { permanent_uuid: "0a035ccd7c2a4182a70ef394adb3b9c8" member_type: VOTER last_known_addr { host: "127.14.175.253" port: 37115 } } peers { permanent_uuid: "8c81f22707ea450b8a91f71122e5ee07" member_type: VOTER last_known_addr { host: "127.14.175.252" port: 45681 } } }
I20260809 02:02:10.853778 7235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:02:10.854444 7256 mvcc.cc:205] Tried to move back new op lower bound from 7316442852674834432 to 7316442852555702272. Current Snapshot: MvccSnapshot[applied={T|T < 7316442852674834432}]
I20260809 02:02:10.859692 7252 catalog_manager.cc:1347] Generated new cluster ID: 81b7fa13cc0c46d78575c0b395b3f6af
I20260809 02:02:10.859774 7252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:02:10.884302 7252 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:02:10.885694 7252 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:02:10.914271 7252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9c1eeb84ffe4c23a70e297ac18f66f5: Generated new TSK 0
I20260809 02:02:10.915257 7252 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:02:10.953153 7197 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.950453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51866 (local address 127.14.175.254:39351)
0809 02:02:10.950575 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.950579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.952065 (+ 1486us) server_negotiation.cc:407] Connection header received
0809 02:02:10.952252 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.952257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.952308 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.952375 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.953019 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51866: BlockingRecv error: recv got EOF from 127.0.0.1:51866 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 02:02:10.954551 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.951167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.14.175.253:37115)
0809 02:02:10.951273 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.951279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.953654 (+ 2375us) server_negotiation.cc:407] Connection header received
0809 02:02:10.953772 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.953775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.953833 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.953925 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.954435 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47158: BlockingRecv error: recv got EOF from 127.0.0.1:47158 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 02:02:10.955062 7195 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.951806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49950 (local address 127.14.175.252:45681)
0809 02:02:10.951926 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.951932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.954013 (+ 2081us) server_negotiation.cc:407] Connection header received
0809 02:02:10.954181 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.954185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.954236 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.954301 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.954876 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49950: BlockingRecv error: recv got EOF from 127.0.0.1:49950 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 02:02:10.958774 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.957198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47168 (local address 127.14.175.253:37115)
0809 02:02:10.957296 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.957301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.957777 (+ 476us) server_negotiation.cc:407] Connection header received
0809 02:02:10.958024 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.958028 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.958112 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.958161 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.958689 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47168: BlockingRecv error: recv got EOF from 127.0.0.1:47168 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 02:02:10.972350 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.963395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47182 (local address 127.14.175.253:37115)
0809 02:02:10.963511 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.963518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.971310 (+ 7792us) server_negotiation.cc:407] Connection header received
0809 02:02:10.971549 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.971552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.971607 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.971661 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.972219 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47182: BlockingRecv error: recv got EOF from 127.0.0.1:47182 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 02:02:10.978111 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.976530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47184 (local address 127.14.175.253:37115)
0809 02:02:10.976627 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.976631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.977170 (+ 539us) server_negotiation.cc:407] Connection header received
0809 02:02:10.977375 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.977378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.977434 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.977488 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.978007 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47184: BlockingRecv error: recv got EOF from 127.0.0.1:47184 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 02:02:10.985898 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.984183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.14.175.253:37115)
0809 02:02:10.984346 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.984350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.984893 (+ 543us) server_negotiation.cc:407] Connection header received
0809 02:02:10.985089 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.985092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.985144 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.985199 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.985793 (+ 594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47186: BlockingRecv error: recv got EOF from 127.0.0.1:47186 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 02:02:10.997622 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:10.996020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47190 (local address 127.14.175.253:37115)
0809 02:02:10.996119 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:10.996124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:10.996715 (+ 591us) server_negotiation.cc:407] Connection header received
0809 02:02:10.996903 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:10.996906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:10.996954 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:10.997006 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:10.997514 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47190: BlockingRecv error: recv got EOF from 127.0.0.1:47190 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 02:02:11.017182 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:11.015860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47204 (local address 127.14.175.253:37115)
0809 02:02:11.016019 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:11.016024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:11.016283 (+ 259us) server_negotiation.cc:407] Connection header received
0809 02:02:11.016456 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:11.016459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:11.016517 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:11.016605 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:11.017058 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47204: BlockingRecv error: recv got EOF from 127.0.0.1:47204 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 02:02:11.052906 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:11.051370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.14.175.253:37115)
0809 02:02:11.051527 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:11.051532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:11.051897 (+ 365us) server_negotiation.cc:407] Connection header received
0809 02:02:11.052099 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:11.052103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:11.052166 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:11.052241 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:11.052781 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47218: BlockingRecv error: recv got EOF from 127.0.0.1:47218 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 02:02:11.120777 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:11.119514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47220 (local address 127.14.175.253:37115)
0809 02:02:11.119673 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:11.119678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:11.119834 (+ 156us) server_negotiation.cc:407] Connection header received
0809 02:02:11.120009 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:11.120013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:11.120078 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:11.120182 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:11.120654 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47220: BlockingRecv error: recv got EOF from 127.0.0.1:47220 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 02:02:11.252206 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:11.250946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47224 (local address 127.14.175.253:37115)
0809 02:02:11.251125 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:11.251130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:11.251271 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:02:11.251451 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:11.251454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:11.251522 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:11.251617 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:11.252087 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47224: BlockingRecv error: recv got EOF from 127.0.0.1:47224 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 02:02:11.511718 7119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:02:11.510374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47228 (local address 127.14.175.253:37115)
0809 02:02:11.510528 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:11.510533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:11.510718 (+ 185us) server_negotiation.cc:407] Connection header received
0809 02:02:11.510898 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:11.510907 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:11.510974 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:11.511071 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:02:11.511606 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47228: BlockingRecv error: recv got EOF from 127.0.0.1:47228 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:02:11.786451 7212 catalog_manager.cc:1259] Loaded cluster ID: 81b7fa13cc0c46d78575c0b395b3f6af
I20260809 02:02:11.786533 7212 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: loading cluster ID for follower catalog manager: success
I20260809 02:02:11.788219 7212 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: acquiring CA information for follower catalog manager: success
I20260809 02:02:11.789533 7212 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0a035ccd7c2a4182a70ef394adb3b9c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:02:11.803299 7247 catalog_manager.cc:1259] Loaded cluster ID: 81b7fa13cc0c46d78575c0b395b3f6af
I20260809 02:02:11.803375 7247 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: loading cluster ID for follower catalog manager: success
I20260809 02:02:11.804889 7247 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: acquiring CA information for follower catalog manager: success
I20260809 02:02:11.806206 7247 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8c81f22707ea450b8a91f71122e5ee07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:02:12.030272 7333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:12.026174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47242 (local address 127.14.175.253:37115)
0809 02:02:12.026475 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:12.026480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:12.026497 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:02:12.026687 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:12.026691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:12.026818 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:12.026940 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:12.027244 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.027783 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.028680 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.028924 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.029050 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:12.029386 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:12.029824 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:12.029968 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:12.030043 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:02:12.030104 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":104,"threads_started":1}
I20260809 02:02:12.037241 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:12.033570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49962 (local address 127.14.175.252:45681)
0809 02:02:12.033834 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:12.033838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:12.033853 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:02:12.033935 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:12.033937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:12.034050 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:12.034155 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:12.034345 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.034908 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.035806 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.036133 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.036227 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:12.036484 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:12.036903 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:12.037000 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:12.037066 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:02:12.037115 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260809 02:02:12.044842 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:12.040765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49978 (local address 127.14.175.252:45681)
0809 02:02:12.040912 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:12.040920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:12.041270 (+ 350us) server_negotiation.cc:407] Connection header received
0809 02:02:12.041322 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:12.041329 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:12.041395 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:12.041463 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:12.041793 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.042500 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.043476 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.043787 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.043887 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:12.044176 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:12.044271 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:12.044344 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:12.044635 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 02:02:12.044698 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:02:12.044948 7333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:12.040265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47250 (local address 127.14.175.253:37115)
0809 02:02:12.040406 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:12.040410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:12.040674 (+ 264us) server_negotiation.cc:407] Connection header received
0809 02:02:12.040940 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:12.040944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:12.041000 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:12.041080 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:12.041413 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.042120 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.043576 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.043825 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.043956 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:12.044414 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:12.044492 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:12.044572 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:12.044721 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 02:02:12.044804 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:02:12.045797 7346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:02:12.040234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51876 (local address 127.14.175.254:39351)
0809 02:02:12.040853 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0809 02:02:12.040857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:02:12.040871 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:02:12.040966 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:02:12.040969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:02:12.041132 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:02:12.041250 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:02:12.041548 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.042357 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.043551 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:02:12.043903 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:02:12.044004 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:02:12.044400 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:02:12.045171 (+ 771us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:02:12.045265 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:02:12.045440 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:02:12.045648 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":79,"threads_started":1}
I20260809 02:02:12.048971 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 6965
I20260809 02:02:12.058478 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 7043
I20260809 02:02:12.067598 15039 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXh4dFo/build/debug/bin/kudu with pid 7121
2026-08-09T02:02:12Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3155 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6271 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (282552 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST